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Vocational rehabilitation agency program audits and 
reviews have revealed problems such as provision of insubstantial 
services to clients, pcor case documentation, large numbers of 
clients not gainfully employed, and provision of services to 
ineligible clients. The problems have remained in spite of 
remediation strategies based on additional controls and regulations 
within state/federal programs. Accordingly, the Management Control 
Project, a research and demonstration project funded by the National 
^ "ttitute of Handicapped Research, was designed to develop, 
iiu^jlement, and investigate an innovative approach to agency 
management. Emphasis is placed on setting performance standards, 
evaluating performance objectively, and providing feedback regarding 
performance. Skilled counselors operate autonomously; the system 
eliminates superficial controls. Experimental testing was completed 
in Georgia, Michigan, and Maryland, each of which has begun statewide 
installation plans. Performance has improved significantly in all 
three states. Analysis of survey data show little change in job 
satisfaction, perceptions of time utilization, and leader 
descriptions. Work alienation surveys demonstrate tnat counselors 
feel that they have significantly more authority regarding their work 
and that they feel less confined by rules. (TE) 
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Foreword 

The initiation of the Management Control Project was 
an effort to enable counselors to function professionally 
in a bureaucracy. Project staff quickly realized that the 
entire management system of the rehabilitation organization 
needed to be examined to assure the compatibility of organi- 
zational goals with professional ideals. 

Initially, it was assumed that the regulations of the 
federal government were the major contributor to a dysfunc- 
tional system. We discovered, however, that, in the words 
of Pogo, "we met the enemy and the enemy was us". State 
programs were imposing much more rigorous controls than 
those imposed by the federal government. Project emphasis 
on policy analysis and development of a policy system which 
clearly identifies requirements and relates them to perfor- 
mance goals may be the major contribution of the Manageuient 

Control Project. 

The practice of a management philosophy which supporcs 
and encourages professional functioning is critical. Super- 
vising professionals is a difficult process; too often, 
we have neglected to emphasize the professional development 
of rehabilitation personnel. Supervision has frequently 
taken the fom of personal supervision and control, thus 
contributincr further to a dysfunctional system. 

We must continue to guard against the creeping introduction 
of controls as solutions to judgmental errors or policy 
noncompliance. This project has demonstrated that the most 
effective solutions are based on sound management practices. 
1 challenge the reader to capitalize on these effective 
management techniques rather than relying on traditiouai 
control approaches to organizational administration. 

i 



Project results convince me that the Management Control 
Project provides the foundation for continued demonstration 
of the utility of the rehabilitation process and for the 
potential of professionals to work within the bureaucracy. 

James G. Ledbetter, Ph.D. 
Commissioner, Department 

of Human Resources 
State of Georgia 
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Preface 



One of the most persistent problems facing the rehabili- 
tation administrator today is that of control. Although 
there are conflicting viewpoints regarding the best manner 
in which to manage an organization, the Management Control 
Project has maintained that good management requires an 
effective system of control. The project's goal during 
this research and demonstration effort has been to achieve 
optimal rehabilitation agency performance through the applica- 
tion of a management system which eliminates unnecessary 
and spurious controls and utilizes performance standard-:; 
maintained by skilled managers. The system is designed 
to assure that actual needs of eligible handicapped individuals 
are identified and that service provision is based on these 
needs, thus enhancing success. This pro-iect has not solved 
all the problems faced oy the administrator in manarjing 
a rehabilitation program nor has it solved all the problems 
faced by the counselor in functioning as a professional 
in a bureaucracy. This final report does present a demon ;5tra ted 
management system designed to recognize the professionalism 
of the rehabilitation counselor while capitalizina on the 
expertise of agency managers. 

In a project of this magnitude, one cannot hope to 
individually thank everyone who has contributed. Durinq 
the project's R&D effort, many people have been involved 
and we gratefully acknowledae their valuable con'r^ibutaons. 

The Management Control Project resulted from coimnon 
interests of Rehabilitation Services Administration, the 
Georgia Division of Rehabilitation Services, and the Rehabili- 
tation Counselor Trainina Program at the University of Georgia. 
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The project was developed from ideas generated by 

Dr. James G. Ledbetter, now Commissioner of the Georgia 

Department of Human Resources, during work on the prospectus 

of his doctoral dissertation. The review of literature 

contained in this document is, for the most part, 

Dr. Ledbetter's work. His conceptulization of a management 

control system for rehabilitation agencies, as well as his 

extensive review of the literature, is acknowledged. 

Special recognition is given to Dr. Jack Crisler, 
University of Georgia, and Mr. Gene Wallace, Georgia Division 
of Rehabilitation Services, who served as project co-directors 
from October, 1978 throuah March, 1979 and gave the project 
a strong start. These men, along with the project fiscal 
officer. Dr. Timothy Field, University of Georgia, have 
provided valuable assistance and support throughout the 
grant period. Thanks is given to Mr. Lewis Davis and the 
RSA Region IV staff who have provided iniput and encouragement 
from the early stages of the project's grant application 
to the present. We acknowledge the contribution of the 
East District managers and counselors of the Georgia Division 
of Rehabiliation Services for their extraordinary services 
on various project developmental committees and for being 
the first group to pilot the manaaement control system. 
Thanks is given to the individuals who gave expert consultation 
and on--going input through participation on the steering 
committee, research design committee, external review teams, 
and training teams. 

The opportunity to demonstrate a management control 
system as an alternative to traditional management approaches 
was possible because of the willingness of three state rehabi-- 
litation agencies to participate in the research and demonstra- 
tion effort. A special thanks goes to Dr. Joseph Edwards, 
Dr. James Ledbetter, and Mr. Thomas Gaines, each having 
served as director of the Georgia Division of Rehabilitation 
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Services; Mr. Peter Griswold, Director of Michigan Rehabili- 
tation Services; and Mr. Richard Batterton, Director of 
Maryland Division of Vocational Rehabilitation. Individuals 
and task groups representing these three agencies have had 
a positive influence on the development of this management 
system. 

A special tribute is paid to Mr. George Engstrom, NIHR 
Project Officer, for keeping us on course and knowing when 
encouragement was needed. Mr. Engstrom's expert consultation 
and commitment to the Management Control Project are gratefully 
acknowledged. 

With the dedication of these individuals, the project 
has become more than a good idea. We hope that this report 
will assist the reader in developing a more effective organi- 
zation. 

Philip E. Chase 
Project Director 
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Abstract 



Vocational rehabilitation agency program audits and 
reviews have revealed problems such as: provision of insub- 
stantial services to clients, poor case documentation, large 
numbers of clients not gainfully employed, and provision 
of services to ineligible clients. The problems have 
remained in spite of remediation strategies focused on the 
imDlementation of additional controls and regulations within 
state/federal programs. Ledbetter (1980) conceptualized 
a manaqement control system for vocational rehabilitation 
programs? a field test indicated there was strong support 
for such a system. The Management Control Project, a research 
and demonstration project funded by thvs Nationax ln«titute of 
Handicapped Research was desiqncd to develop, implement, an:.' 
investiqate an innovative approach to agency manaqement, 
Emphasis is placed on setting perfonnanco standards, evaluacinq 
performance objectively, and providing feedback regarding 
performance. SkiTTed counselors operate autonomously; the 
system eliminates superficial control;?. Experimental field 
testing was completed in Georaia, in Michigan, and in Maryland. 
In Georgia, the system has been installed statewide, statewide 
system installation has bequn in Michigan, and statewide 
installation plans are underway in Maryland. Performance has 
improved sign if ic -in tly in all three states. Analyses of survey 
data show little change in job satisfaction, perceptions of 
time utilization, and leader descriptions. Work alienation 
surveys demonstrate that counselors feel that they have sig- 
nificantly more authority reqarding their work and that they 
feel less confined by rules regarding their work. 
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A. Overview of Project. 



Introduction 

For more than six decades, vocational rehabilitation 
agencies have broadened service delivery components and 
clientele through expansion and technological advances. The 
professional development of service delivery providers with- 
in state-federal vocational rehabilitation programs har 
continued at a commensurate rate. Ne"<'ortheless, numerous 
client service delivery system problems have emerged. The 
traditional systems of vocational rehabilitation service 
delivery have not been working; moreover, the "add-on", 
or "band-aid" attempts for remediation and minimization of 
vocational rehabilitation's problems and concerns have not 
been effective. Thus, the need for a "total -revamp" or 
"totally-new" approach was indeed eminent. With the scarcity 
of system-wide approaches, it is, therefore, fitting to 
address those critical factors which led to the development 
and implementation of the Management Control Project (MCP) . 

Statement of Problem 

Since it?.; inception in 1920, the state-federal rehabili- 
tation procjrriin has 'tjrov/n r?.pidly in terms of funding/ personnf?!^ 
and services provided to handicapped citizens. That growth 
has been the most dramatic in recent years. In the 10-year 
period from 1966 to 1975, for example, funding for Vocational 
Rehabilitation purposes increased from 214 to 998 million 
dollars. With these dramatic increases in fund allocations 
came a significant expansion in the program of services. 
In that same time period, the number of persons employed 
by rehabilitation programs grew from 12,000 to 32,000 — an 
increase of 167%. Massive increases in personnel, many of 
whom were largely untrained or inexperienced, coupled with 
the 1973 federally mandated shift toward serving a more 
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severely disabled population, created a need for more in- 
service training and greater casework supervision. These 
needs led to a large increase in financial support to maintain 
and upgrade the skills of state-federal vocational rehabili- 
tation program employees. Between 1966 and 1975, state agency 
in-sorvice training grants increased from $480,000 to $2,000,000 
(RSA, 1975) resulting in many training programs in job place- 
ment, case processing, and counselor supervision. A rapid 
increase in casework supervision occurred. With the increased 
funding for case services and increased in-service training 
for rehabilitation personnel, it was not surprising that 
the economic conditions of the past decade surfaced "Account- 
ability" as a crucial issue for state-federal vocational 
rehabilitation programs. Rule and Wright (1974) suggested 
that the public was reacting to the state-federal inability 
to portray and demonstrate that the provision of vocational 
rehabilitation services, in a utilitarian sense, is an invest- 
ment. 

Official audits conducted over the last 10 years by 
the General Accounting Office, the Department of Health, 
Education, and Welfare Audit Agency, and the Rehabil itatiou 
Services Administration indicated that problems still existed. 
These problems were identified as the provision of insubstan- 
tia} servi.of??? , poor case documentation,, inadequate benefits 
obtained by clients, large numbers of clients not gainfully 
employed, the provision of services to ineligible clients, 
and the failure of the Social Security Disability Insurance 
Program to remain cost effective. In spite of increasing 
attention to placement in the forms of research, demonstra- 
tion, and training, a 1978 audit (HEW Audit Control Number: 
15-70300) was sharply critical of counselor placement efforts. 
It was reported that too few clients were placed in competitive 
employment and too many former clients were unhappy about 
the usefulness of the services they received. 
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Confronted with deficiencies such as those mentioned 
above, the state-federal vocational rehabilitation program 
initiated corrective measures which led to the establish- 
ment of additional controls. The Rehabilitation Services 
Administration began a systematic series of Program Adminis- 
trative Reviews of the Social Security Beneficiary Rehabili- 
tation Program (BRP) to evaluate the manner in which the 
state rehabilitation agencies were administering the program. 
The immediate result was the requirement that each determina- 
tion of eligibility be reviewed by the counselor's supervisor 
(RSA, 1975). Unfortunately, RSA's implementation of more 
accountability through controls such as this was not met 
with more overall effectiveness. 

Some state rehabilitation agencies responded to the 
deficiencies by mounting comprehensive case reviews and re- 
quiring supervisory approval for IWRP ' s and case closures. 
State VR agencies have established means of quality control, 
but the term "Quality Control" has frequently been perceived 
as a negative mancu-remcnt practice which is not supportive 
of the procjGssional goals of rehabilitation. Within the 
organizational structure of state rehabilitation agencies, 
it is viewed primarily as a supervisory casework monitoring 
and approval process „ 

In considering the Vocational Rehabilitation Act of 
1973 (P.L. 93-112) , the United States Congress became aware, 
through the testimony of consumers, organizational represen- 
tatives and rGhabilitation professionals, that disabled 
clients often were not being sufficiently involved in the 
development of their own rehabil itat.i on programs. In response 
to that criticism, Congress included in the Rehabilitation 
Act of 1973, the requirement that every client have an Indi- 
vidual Written Rehabilitation Program (IWRP). This program 
was to be developed jointly with the client and it was to 
be evaluated annually (U.S. Government Printing Office, 1975). 
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In summary, vocational rehabilitation program responses 
to identified deficiencies have been the institution of 
greater supervisory controls and the implementation of more 
stringent policies and procedures. These efforts, however, 
have not been effective. In addition, many rehabilitation 
counselors have perceived them as contrary to professional 
practice, and it is suspected that the morale of direct ser- 
vice workers has consistently declined. The program defi- 
ciencies continue and management of the state/federal rehabi- 
litation program is under increasing pressure to correct 
the problems. Current supervisory and procedural controls 
have not solved the problems. Therefore, the need for a 
new approach to deficiencies in the quality and quantity 
of client services was evident. 

The dramatic growth of the state-federal vocational 
rehabilitation program since its inception has area Led 
a dysfunctional system which threatens our survival 
[vocational rehabilitation agencies]. Dysfunctional ity 
has developed from simultaneously occurring factors 
which are contradictory rather than complementary. 
Specifically, rapid growth has encouraged the addition 
of more and more agency controls to insure that counselors 
are complying with federal lav; snd regulation while 
also stimulating a hiqhly trained counseling staff to 
desire and work for professionalism. 

During the growth period, particularly 1966-1975, 
we [vocational rehabilitation] have experienced signifi- 
cant program funding increases, massive personnel in- 
creases, shifting in our service population emphasis, 
substantial increases in training grants, and many pro- 
grammatic changes. These developments prompted regula- 
tions to cover as many contingencies as possible and 
encouraged the use of more and more supervisory staff. 
Unfortunately, the supervisory staff has functioned 
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more to monitor adherence to regulations than to assist 
counseling staff. 

Rapid growth created an abundance of promotional 
opportunities and caused agencies to dig deep into their 
talent barks, thus diverting much of the best talent 
from service delivery to administration. This resulted 
in some staff, unprepared and unsuited to administration, 
moving upward and caused both decline of talent at the 
service delivery level and development of poor adminis- 
tration and supervision. As growth has reached a plateau, 
potential for upward mobility and extrinsic reward has 
declined and the agency has become less attractive to 
talented practitioners. 

As we continue to add control and increase supervision 
in order to eliminate deficiencies, we also continue 
to seek bright, well- trained counselors, asking them 
to effectively function within this system which neither 
enhances nor encourages professionalism. Once employed, 
these counselors are faced with a dysfunctional aysl.ura 
which discourages professional and independent func-' 
tioning, and offers few opportunities for promotion „ 
The result is dissatisfaction and the necessity of 
electing to leave the agency; to stay with the .*v.jenuy 
and conform, perhaps creating a mornle problem; or 
to stay with agency and fiqht for professional rights, 
perhaps increasing efforts toward unionism. Both those 
who leave and those who stay but conform represent losses 
to the agency. Those who choose to stay and fight are 
in conflict with management and may create addi.tio;'ial. 
problems for a control-orieii ted sysjtcm. The v^arning 
is clear — it is the responsibility of management to 
change, to create a climate in which professional rehabi- 
litation counselors are able to utilize their training 
and expertise (Chase, Lindsay, & Patrick, 1980). 
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The need for a management system which facilitates com- 
pliance with the intent of the Rehabilitation Act and federal 
regulations regarding rehabilitation is well documente'^. 
The Council of State Administrators of Vocational Rehabili- 
tation (CSAVR) , on April 20, 1982, adopted a position paper, 
prepared by the CSAVR Client Services Committee, which states: 
Various external and internal audits zave consistently 
yielded results which leave little doubt among some 
vocational rehabilitation administrators that what on 
the one hand seems to be clear, uniform eligibility 
requ' ments are, on the other hand, being used with 
discretion by some vocational rehabilitation agencies. 
The question of how agencies can fail to practice what 
the law requires naturally arises ... .First, there is 
the generic problem of inadequate documtintatior. (infor- 
mation) support of the eligibility system. Ttdditionally , 
comments about inadequate documentation have reported 
the absence of medical information to support the stated 
disability and/or no documentation 'oncerning the 
existence of a vocational handicap. Second, there js 
the prnblem of. agencies serving ineligible individuals. 
Usually auditors report as ineligible cases in which 
fciven iKjfi- v(.)'Jcj Lion vi 1 rehabilitation pracriiioiii'?. ^ cai. 
discern the lack of a disability or handicap. 
The position paper qoes on to state that the results 
of the San Diego State University Case Review Schedule, 
applied to over 3,000 cases in 36 agencies, indicate that 
4 9% of the cases surveyed contain questionable eli.gibility 
practices. These findings are consistent with the .'(anaqement 
Control Project (MCP) pretest results in three rcaUew which 
show that 22-29% of the cases reviewed contained inadequate 
medical/psycholoaical documentation, 49-85% contained inade- 
quate documentation of vocational handicaps and 56-86% con- 
tained inadeauate documentation of reasonable expectation 
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of employment. MCP pretest results also indicate that 
legally mandated IWRP requirements were not met in 65-100% 
of the cases, basic financial accountability requirements 
were not met in 63-87% of the cases, and case closure docu- 
mentation requirements were not met in 18-60% of the cases. 
The MCP's original objective was to correct the deficiencies 
and reduce controls on counselors through a system of per- 
formance standard by which counselor work would be measured 
and rewarded as appropriate. 

If in the history of vocational rehabilitation it has 
been observed that control-oriented systems have been 
dysfunctional (and out of control), then it seems rational 
to assume that the first step is to consider establishing 
a system that could control the controls within it. Thus, 
an investigation of the various controls within systems, 
as well as the functions of such controls, is purposeful. 

T.itp?rature Review 

Hasenfeld and English (1974) stated that human service 
agencies, characterized by service goals or criterion measures 
that are ambiguous, attempt to establish control and account- 
ability by developing extensive record keeping requirements 
and by utilizing supervisors to closely monitor the activities 
of service delivery staff. Their focus, both overt and covert, 
on the control factor of human service agencies appears criti- 
cal—control is one of the major functions of management. 
It is described as that function of management which is con- 
cerned with securing the necessary resources to be used 
effectively and efficiently to accomplish the goals and 
objectives of the organization (Anthony & Herzlinger, 1975). 
Newman (1975) described managerial control as the "...series, 
etc. of stepg a manager takes to assure that actual perform- 
ances conform as nearly as practicable to the plan" (p. 5). 
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One of the more traditional forms of managerial control is 
the personal supervision by the manager. In large, complex 
organizations this form of control is neither efficient nor 
is it effective when employed with professional workers. 

In attempting to classify control systems, Anthony 
(196 5) related them to the purposes they serve in the 
organization: controlling employee's present behavior, 
providing employees feedback about job performance, and 
furnishing management information for long-range planning. 
Nowman (1975) classified controls into steering, screening, 
and post-action control functions. He stated that each 
type of control serves a discrete function, but that these 
functions may be integrated to develop an effective system 
of control. The minimum elements for a control system 
have been described by Lawler and Rhode (1976) aw the estab- 
lishment of objectives or outcomes related to worker or 
organizational behavior, the establishment ana execution 
of a plan to reach those objectives, aad the coll^tiction of 
information about the effectiveness of bhe action. Th^^- 
ultimate goal of the control system is to assess the per- 
formance of the individual or organization in reJation to 
some predetermined standard. 

Lawler and Rhode (1976) developed an infomatifn; , :d 
control system model. They compared it to a thermostat, 
and broke it into the components of a measurement system 
or sensor: an adjustable standard, a function that compares 
the sensor to the standard, a mechanism that responds to 
the comparison, a means of transmitting the message, the 
measurement of a task or activity, and that which motivates 
or powers the activity. The common elementti of control 
systems relate to the measurement function , the method and 
system of evaluation, monitoring or discrimination, and the 
motivating force of the worker and organization. 
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The measurement of employee and organizational 
effectiveness is regarded as an oppressive, negative 
activity. Although effectiveness of control is 
readily acknowledged, its potential for use as a 
positive force to guide workers' behavior has not 
been fully explored. The use of control systems as 
a stimulant and motivator of worker behavior should 
be incorporated into the design of organizations 
(Ledbetter, 1980) . 

The functions of control include setting the objective^ 
goals and standards; determining a method of measurement; 
and assuring the objectivity of measurement. Hostility to- 
ward control systems often occurs when the organization sets 
unrealistic goals, establishes inaccurate and incomplete 
measures of performance, and fails to involve the employee 
in the establishment of goals (Lawler and Rhode, 1976; Newman, 
1975; Todd, 1977) . The negative consequences of inadequate 
measurement can be demoralization of employees and a delete- 
rious impact on the organization. 

Control systems utilizing unrealistic or inappropriate 
standards can result in employee behaviors that look good, 
but that are dysfunctional in terms of accomplishing organi- 
zational goals. For instance, Todd's (1977) analysis of 
the equity funding scandal was that the organization had 
established unattainable goals, and the employees reacted 
to this pressure by falsifying reports on assets and 
liabilities. 

Blau (1955) found, after analyzing a state employment 
service agency, that control measures had been placed on 
the process functions of interviewing, counseling, and refer- 
ral rather than on the product of job placement. The result 
of these measures was an increase in interviewing, counseling, 
and referral and a corresponding decrease in job placement. 
The goals of the organization were not being met, but the 
employees looked good on standards against which their 
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performance was being measured; this standard did not 
accurately measure the organization's goals, only some of 
the means of achieving the goal. 

In the organizations that measure process, Lawler and 
Rhode (1976) found that employees do attempt to influence 
information system results so that they will look good for 
a certain period of time. Newman (1975) stated that the 
preoccupation with process rather than the organization's 
basic objectives makes the control effort ineffective. The 
upper echelons of management become concerned with output 
in isolation, and the managers at the operative levels focus 
their control efforts on process requirements. 

The involvement of employees in the establishment of 
goals and standards is a management technique widely advo- 
cated to increase the employee's understanding and acceptance 
of the organization's goals. The impact of goal setting 
on increasing the performance of employees has been well 
documented (Latham & Kinne, 1974; Locke, 1968; Locke & 
Bryan, 1969; Vroom, 1960). However, when the goal setting 
is used as a standard against which the employees will be 
measured, the impact of employee participation seems to be 
effective only when it is a part of the overall management 
strategy and when the employees feel that they ought to be 
inv^olved (Hopwood, 1973). Newman (1975) stated that parti- 
cipation helps to develop mutual understanding, to establish 
meaningful criteria that are measurable, and to set stimu- 
lating standards. He further stated that participation is 
necessary for control mechanisms to be effective. Lawler 
and Rhode (1976) indicated that employees must be aware of 
the information that was used to set standards. The concen- 
sus seems to be that employees whose performance is being 
measured ought to be involved in the goal setting process. 

The level of goal difficulty is another important aspect 
of the measurement function of a control system. Locke (1968) 
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stated that research studies indicate that difficult goals 
produce a higher level of performance than easy goals. Dif- 
ficult standards or goals motivate workers if they feel 
the goal is attainable with reasonable effort and if they 
work in a supportive atmosphere (Newman, 1975), 

Newman (1975) further stated that controls are meaning- 
ful to the individual when they are expressed in operational 
terms, when the worker can affect the outcome, and when the 
ou-^come can be clearly measured. Lawler and Rhode (1976) 
reported studies that indicated managers were motivated to 
perform v/ell only by measures that accurately assessed their 
performance. 

The method or system used to apply the standard, goal 
or objective to performance involves the individual perform- 
ing the measurement, collection of data at an appropriate 
time, and the individual being measured. The individual evalu- 
ating the work and applying the standard to the actual per- 
formance is crucial in the measurement process. Lawler and 
Rhode (1976) stated that the discriminator must have two 
attributes: the technical knowledge to make the comparison, 
and the trust and confidence of the person being measured. 
If rewards are related to employee's performance, these two 
factors are essential. It appears appropriate to have the 
employees' line supervisors involve-? in the measurement 
process. Newman (1975) stated that the measurement process 
is more effective if it is close to the operational level. 
ThiG closeness assures that the evaluator will maintain tech- 
nical expertise and the confidence of employees. 

The involvement of individuals being evaluated is critical 
especially for organizations that cannot or do not link job 
performance to extrinsic rewards. These individuals have 
the most knowledge of the process, bring needed information, 
and are more likely to trust the evaluation procedures if 
they are involved. Research on performance appraisal (Barnes 
& White, 1971; Campbell et al, 1970; Lawler & Rhode, 1976) 
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suggests that subordinates should actively participate in 
their supervisory ^ valuation; some researchers have suggested 
that subordinates should participate as equals. 
Factors which ourtbt to be considered in the 
measui-ement process are promptness of the moasure- 
ment, its reliability and validity, its expense, 
and the comprehensiveness of the measurement. 
Statistical techniques can be employed ♦-.o insure 
the reliability and validity of the measurement, 
especially when different individuals are per- 
forming the measurement. The use of statistical 
Lampling can minimize expense and ensure adequate 
representation (Ledbetter, 1980) . 
Blau (1955), Newman (1975), Lawler and Rhode (1976), and 
Todd (1977) all emphasized the need to use control sparingly 
and to choose those strategic points in the system that 
relate to the organizational goals. Newman (1975} emphasized 
the predicting functions of controls and suggests that when 
organizations rely on actual "'^sults 'ilone as evaluatioi. 
tools, managerial control wi i e ineffective. For thxa 
reason, Newman stressed steering controls which allow 
organizations to make mid-course evaluations and to initiate 
constructive changes before the end result has been achieved. 
He acknowledged the value of post action controls which tie 
together rewards and results and which provide the organization 
data to be used in planning for similar work in the future. 

The purpose of the measurement system is to provide 
feedback to the workers so that corrective actions can be 
initiated. If learning is to take place, corrective action 
must occur. Argyris (1976) stated that the degree to which 
learning takes place can be affected by increasing the vali- 
dity of the information and the degree to which it is 
accepted by the. person being evaluated. Argyris further sug- 
gested that factors inhibiting valid feedback become more 
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operational as the consequences become more threatening to 
those people involved. Valid information is generated more 
easily for less threatening and less important decisions. 

The effect of knowledge of results, or feedback, on 
job performance is well documented by Kim and Hammer (1976) 
who reported that feedback provides the employees a directive 
to keep job behaviors on the desired course and that it further 
serves as a stimulator for greater effort* In a study combin- 
ing self-generated knowledge of results with supervisory-- 
generated knowledge and praise, they found that performance 
was greatly enhanced. In another study, Cummings, Schwab, 
and Rosen (1971) found that when employees were provided 
with accurate feedback based on standards that were clear 
and made known to the cmployaes, maximura job performance 
was achieved. Latham and Kinne (1974) found that feedback 
must be tied to aoal setting before it is effective, 

Odiorne (1973) , Newman (1975) , and Lawler and i?hode 
(1976) found that the speed of feedback is important if learn-' 
ing is to occur as a result of the feedback. Resistance 
v/ill be minimized and employees will be knowledgeabj o of 
the conditions '/nder which corrections must be made (Ne^Aorian^ 
1975). Theories of learning have long established the rela- 
tionship between the immediacy of feedback and the :?Krv.\\(;lh 
of the feedback as a reinforcer. 

In private industry, extrinsic rewards can be provided 
to those who demonstrate high performance levels. Lawler 
and Rhode (1976) recognized that extrinsic reward is not 
possible in all organizations and suqaested that for intrinsic 
motivation to occur, the control system must allow for worker 
autonomy, t:ask identity, variety of job, and feedback. 

Within a state or federal bureaucracy the opportunity 
for extrinsic rewards is limited. Because vocational reha- 
bilitation service workers perceive themselves as professionals, 
intrinsic motivators can be utilized. Anthony and Herzlinger 
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(1975) recognized that management control is limited in non- 
profit organizations, especially when those individuals 
controlled are professional. The need to relate the control 
measures to professional goals can be a difficult task, es~ 
pecially within a bureaucracy. Peele and Palmer (1976) dis- 
cussed the problems of quality control in mental health pro- 
grams. They recognized the need for quality assurance and 
indicated that the professional's concern must be to insure 
that "quality assurance is first and foremost in tune with 
competent, compassionate and creative responses to the needs 
of the patient" (p. 154) . If the specific controls in state 
federal programs are to be examined and ultimately utilized 
for more desirable program outcomes, it is necessary to 
examine those unique characteristics of the state-federal 
VR Program. 

As previously mentioned, the provision of professional 
vocational rehabilitation services to handicapped persons 
in the public sector involves operational issues somewhat 
different from those in profit-oriented programs, Sinits 
and Ledbetter (1979) focused on three critical differences: 
First of all, th& legislation which creates, maintains, 
and funds them sets specific parameters within which 
they are expected to function. While specific legis- 
lative requirements typically define the broad aspects 
of agency operations, the day-to-day functioning and 
accountability systems are further defined by admi.ia- 
trative regulations. ... Secondly , public attitudes 
and values influence the legislation and regulations 
which quide the operations of the agency ... .And thirdly 
all public service agencies compete among themselves 
for scarce resources (p. 80) . 
Thus as a result of existence in the public sector, amid 
governmental regulation, ambiguity regarding goals, and a 
lack of consistent measures of effectiveness, state VR 
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agencies have evolved in a manner such that today "VR 
programs are close to control saturation" (Crisler, Field 
& Pierson, 1980, p. 53). There is other evidence which 
points to the increase in management controls. Rehabilitation 
Services Administration program data (1977) reveals that 
administrative costs in the state/federal programs increased 
from 5.9% to the total VR expenditures in 1972 to 8% in 1976. 
Furthermore, 12% of the personnel employed in VR programs 
were directly involved in administrative activity. With 
the overloading of persons in power positions, power and 
control can be ambiguously used, other workers can experience 
power-deficits, and alienation from the organizations can 
be expGrienccd by cmployccc (Shspard L Panko, 1974) . 

In addressing the natural conflict or tension between 
the professional and the bureaucracy, Smits and Ledbetter 
(1979) suggested some illustrations of the impact of these 
tensions on rehabilitation counseling: 

The most graphic examples are in the area of the 
agency's system of accountability. The impact of 
the agency's system of controls is in direct conflict 
with the professional role of the rehabilitation 
counselor and this conflict results in alienation 
and heightened tensions (p. 81) . 
These conditions may have detrimental effects on rehabilita- 
tion professionals who are disturbed by the dysfunctional 
aspects of the conditions. 

Traditional vocational rehabilitation systems have not 
appropriately responded to the needs of professional rehabil- 
itation counselors working within them. Miller and Muthard's 
(1965) research indicated that rehabilitation counselors' 
job satisfaction was not associated with the views of adminis- 
trators regarding the number of closures attained. Effects 
of identified rehabilitation counselor role strain have been 
noted in recent professional literature. Miller and Roberts 
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(1979) addressed some of the primary issues of how "•♦.ambi- 
guity in performing key job tasks, as well as how the Zeiqar-- 
nik effect (tension arising from not being able to complete 
or get "closure" from job tasks) , influence rehabilitation 
counselor job needs, [and] contribute to counselor dissatis- 
faction or burnout..." (p* 60). Smits and Ledbetter (1979) 
suggested that while rehabilitation counselors may experience 
some degree of participative management at the unit level 
of the organization, they seldom have input at the policy- 
making levels of their agencies. 

In summary, the inherent qualities of traditionally 
managed state VR agencies have been dysfunctional and counter- 
productive Lu high level functiioning of professionals working 
within them. Recent rehabilitation literature clearly reflejta 
that less than positive effects of traditional over-control 
by state VR agencies have been felt by rehabilitation adminis- 
trators, supervisors, and counselors. 

State VR agencies may now be experiencing what Oovvns 
(1967) called the "Law of Increasing Conservatism:" "Ail 
organizations tend to become more conservative as they get 
older, unless they experience periods of rapid growth or 
internal turnover" (p. 20) . In recent years^ amid large 
federal budget deficits and cutbacks in many federally funded 
programs, rehabilitation agencies have become static in terms 
of growth or have been forced to reduce in terms of pc.rsonnol 
and budget. During these years that rehabilitation bureaucracy 
may have become counter--productive to the goals and purposes 
of rehabilitation professionals. Most writers eguate expertise 
and professionalism with a flexible, creative, and equalitarian 
work organization while bureaucracy is associated with rigidity, 
and with mechanical and authoritarian work organization 
(Freidson, 1977). Mosher (1968) indicated that, in the eyes 
of most professions, government appears not much better than 
politics; it carries a political taint and violates or 
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threatens treasured professional attributes such as individual 
autonomy, freedom from bureaucratic control, and vocational 
self-government. The sources of organizational dilemmas 
is the lack of fit between personal and organizational roles, 
and Etzioni (1964) concluded that if this difficulty were 
improved, there would be fewer pressures to displace goals, 
Tsss need to control performance, and greatly reduced 
alienation. 

Management control systems consist of integrated steps 
involving goals for the organization and employee, a system 
of measuring the results or accomplishments, and planned 
managerial response in relation to these measurements (Todd. 
1977). The historical, large, and complex state vocational 
rehabilitation agencies have operationalized a personal 
control model which has neither been "...efficient or effec- 
tive when used with professional workers" (Crisler, Field, & 
Pierson, 1980, p. 54). As Todd (1977) pointed out: 

To be successful in their quest for valued job out- 
comes, employees need not only an assignment of 
authority (individual control and influence) but also 
an understanding of the means and ends of their 
mission — that is, how it can best be done (clarity) 
and how it can help them accomplish their individual 
goals (performance — rewards relationships) (p. 69). 
The need for establishing "better" organizational clcLmate 
and more effective Ip.adership within state vocational rehabil- 
itation agencies has been predicated on predicted postive 
effects on the professionals working within the agencies 
and their improved qua^.ity of services to clients (Pacinelli 
& Britton, 1969) . Job satisfaction has been associated with 
such variables as; (a) choice among behavioral alternatives 
(Herman, 1973); (b) achievement, recognition, and responsibility 
(Dunnett, et al. , 1967) ; (c) feelings of importance (W.E. Upjohn, 
1973); (d) the work milieu (Warr & Wall, 1975; (3) job 
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attitudes (Hertzberg, Mausner, & Snyderman, 1959); (f) exper- 
ienced meaninqf ulness and responsibility, and knowledge of 
results of one's efforts (Hackman, et aL, 1975) ; and, (g) the 
opportunity to participate in making decisions which have 
future effects on employees (Vroom, 196Q) . 

As an alternative to professionals being controlled 
by dysfunctional policies and traditions, the MCP was designed 
to utilize the least number of controls possible and to encour- 
age professional understanding of the controls affecting 
performance. Historically, state vocational rehabilitation 
agencies have experienced what has been described as the 
"vicious cycle syndrome": 

The breakdown of rules begot more rules to take 
care of their breakdown, or the breakdown of close 
supervision encouraged the use of still closer 
methods of supervision and, as a result, the con- 
tinuous search and invention of new control systems 
to correct for the limitation of previous ones (Todd, 
1977, p. 10) . 

Dysfunctional outcomes of traditional systems may include 
employee resentment and hostility toward the setting of un- 
realistic goals, the demand for excessive paperwork, inaccurate 
performance measurement, and a lack of employee participation. 
The MCP model operat ionalizes realistic goal development, 
realistic work demands of personnel, fair and accurate per- 
formance measurement, and employee participation. SmitS 
and Ledbetter (1979) suggested the development of mutual 
respect amonq various professional and administrative groups 
is urgently needed in order to improve the quality of work 
life in state vocational rehabilitation agencies. 

Early in development of the MCP, it was acknowledged 
that improved results (numbers of employed clients) could 
be expected if there is improvement in eligibility determin- 
ation, IWRP formulation and delivery of services. Thus, 
focus on these key elements of the rehabilitation process 
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and reduction of superficial audit-based controls were 
integral to the structure of the MCP. Critical to the MCP is 
the operationalization of a management system in which skilled 
counselors operate with an optimal degree of autonomy; the 
emphasis is on the development and maintenance of counselor 
performance skills considered critical for independent function- 
ing. The enhancement of professionalism is basic to the MCP. 

In conclusion, the MCP developed out of (a) difficulties 
with measure of auality and outcome, (b) recognized problems 
and dysfunctions within traditional state-federal vocational 
rehabilitation systems, and (c) an abundance of theory and 
research results supporting the management control system 
approach. Gaines (1980) suggested that MCP philosophy, objec- 
tives , and performance standards would become the framework of 
an imoroved system of vocational rehabilitation. 

Management Control Project Pilot States 
In October, 1978, a research and demonstration grant was 
awarded by Rehabilitation Services Administration to the 
University of Georgia for the purposes of investigating, devel- 
oping, and implementing an innovative approach to the manage- 
ment of vocational rehabilitation service delivery. Funding 
responsibility for the grant shifted to the National Institute 
of Handicapped Research when it was established. 

The Management Control Project was conceptualized in 
several phases and its research design projected the involve- 
ment of three state rehabilitation agencies. Project concepts 
were to be tested in a demonstration area of an initial pilot 
state, refined, and if successful, demonstrated on a statewide 
basis. Following successful implementation statewide, the 
applicability of the management control system was to be 
demonstrated in two additional states. 

The Georgia Division of Rehabilitation Services became 
the project's first pilot agency in 1979. Michigan Rehabili- 
tation Services joined the project in 1981 followed by the 
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Maryland Division of Vocational Rehabilitation in 1982. As 
proposed by the project, the three states exhibit different 
sociogeographic and economic factors. Georgia is basically 
a rural state with low density population and little unioni- 
zation. Income and cost of living are comparatively low. 
Current unemployment is 8%. Michigan is highly industrial- 
ized and has medium density population with more urban centers 
than Georgia. The main industry, motor vehicle production, 
is down about 20% and has contributed to a 17% unemployment 
rate. VR counselors have recently unionised in Michigan, 
however, there has been nu direct effect yeu oLher Llidn Llib 
precipitation of preventive management action regarding 
performance expectations. The union contract covers n^ultiple 
human service agencies; rehabilitation countjelors aro a 
minority in collective bargaining. The majority of workers 
in Maryland are involved in non-manufacturing occupations 
(mainly government employment) with approximately 16% of 
the workers engaged in a variety of manufacturing oc-r upatioiib. 
Maryland has relatively high density population, low aniorii- 
zation, and an unemployment rate of lOl (unemployment rates 
are higher in the experimental areas) . 

Project implementation strategy was similar in the 
three states. Experimental and control populations which 
are as similar as possible, were selected. The experimental 
population in Georgia consisted of one dis^triot director, 
one assistant district director, and three first- line super- 
visors who manage 3 2 rehabilitation counselors. Later, the 
entire state agency became an experimental base. The experimental 
population in Michigan consisted of four area administrators 
(who have dual responsibility-there is one experimental 
office in each area while all other offices in each area 
operate as usual) , four assistant area administrators who 
are responsible for the performance of nine first-line 
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supervisors who manage 42 rehabilitation counselors. The 
Maryland experimental population consisted of two regional 
directors who are responsible for the performance of eight 
first- line supervisors who manage 41 rehabilitation counselors 
and six rehabilitation specialists. 

Very little advance supervisory training was conducted 
in Georgia prior to project implementation. Because of 
the Georgia experience and a recognized need, a week of 
management training in the application of project standards 
and criteria to case review was conducted in Michigan in 
November, 1981 and in Maryland in PebrtJary, 19B2. Partici- 
pants were experimental first-line supervisors, and personr.el 
responsible for supervisory perfonnance and quality assurance. 

Staff training for experimental staff was conducted 
in Georgia during April, 1979; for Georgia statewide staff 
during February- June, 1980; Michigan staff during December,. 
1981; and Maryland staff during March, 1982. 

The following is a synopsis of the environmeiit foui-^d 
in the three agencies prior to management control nystem 
implementation. Also discussed are factors which influenced 
the participation of Georgia, Maryland, and Michigan in 
the Management Control Project. 
Georgia Division of Rehabilitation Ser vices 

The period during 1979-80 saw the Georgia agency pursue 
and achieve several philosophical and prog ran">:aa tic chanv^es. 
The climate was ripe for agency management to progress from 
a reactive to proactive planning and management approach 
so that it could better deal with some rather long-standing 
issues related to client services. The Management Control Pro- 
ject's philosophical base v/as formulated during this climate 
of change. 
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The philosophical and programmatic changes occurred during 
a period characterized by several perplexing issues: 
(1) declining resources; (2) increasing consumer demands for 
services; (3) increasing emphasis on accountability; and 
(4) growing competition among public ageP'^ies for available 
tax dollars. Moreover, specific concerns developed as conse- 
quences of federal, state, and internal program audits. Those 
concerns related to findings that ineligible clients were 
being served; that many clients were not involved in their 
individual rehabilitation programs; that insubstantial services 
were being provided in many casea; and that financial account- 
ability was generally weak. 

Compounding all of these issues and concerns was top 
management's growing desire for the agency to increase ser-ices 
to severely handicapped persons; to rid its service delivery/ 
case recording control system of its increasingly obvious 
dysfunctions; and to enhance the professional role and image 
of rehabilitation counselors. Several changes btgan co occur 
during 1978 in response to these issues, concerns m.d de. i^.i.-^. 

First, an Order of Selection policy was developed, field- 
tested, and subsequently implemented division-wide. The net 
effect of the policy was a shift in service delivery '-o-us 
to provide that the majority of individuals served ivoula 
be severely handicapped. 

Second, the Executive Committee (agency top management) 
engaged in formal team building activities. It was during 
these activities that the agency's management philosophy, 
consumer philosophy, organization values, and mission were 

literally re-defined. 

Third, the MCP was developed and implemented on an experi- 
mental basis. The rationale for undertaking the Project was 
based upon its potential for addressing a number of major issues 
related to the service delivery system, accountability and 
professional practice. Results during the first year of the 
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Project convinced agency management that the potential was 
real, and a decision was made to implement on a division- 
wide basis. 

Fourth, there was a revamping of the division's basic 
organizational structure and a functional realignment of all 
state office personnel. One of the particularly significant 
changes in the structure was the emergence of Quality Assurance 
as one of the seven major work sections (organizational 
components) of the division. Previously a sub-unit in a 
section, the evaluation from unit to section underscored 
management's commitment to programmatic quality and account- 
ability. 

Fifth, a new policy development/implementation system 
was designed and a revised Manual of Policy (case service 
operations) was subsequently completed. 
Michigan Rehabilitation Services 

Michigan Rehabilitation Services has a staff of 480 
located in 34 district and state office locations. Within 
the past three years the state agency has incurred a reaacvici 
of approximately 300 staff positions. These reductions have 
occurred through both attrition and layoffs. Based upon these 
reductions in staff, the current span of control within -.he 
district office locations is not consistent. 

During the late sixties and early seventies tho Michigan 
agency installed Management by Objectives and Planning, 
Performance and Budqet systems. These management systems 
were provided to assist counselors, supervisors, and adminis-- 
tration in identifying goals, identifying required resources, 
and evaluating performance. Over a period of ten years, this 
emphasis began to focus more upon the monitoring and controlling 
functions of management. 

Supervisory functions have focused upon a centralized 
authority or approval for major casework transactions. This 
approval process has not enabled supervisors to focus on 
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coaching and intervention skills. Michigan casework policies 
have utilized the Federal Regulations as a base, these have 
been expanded to include numerous Michigan policies. The 
casework policy manual incorporates both policy statements 
and preferred rehabilitation practices. 

During 1980, the Michigan state director formulated a 
service delivery task force to review and develop alternate 
methods for providing client assistance. A team of staff 
reviewed the feasibility of piloting the MCP and recommended 
participation. In view of the need to refocus service delivery, 
and maximize human resources in a time of declining resources, 
the Michigan agency decided to pilot test the MCP beginning 
December 1, 1981. 

Maryland Division of Vocational Rehabilitation 

There were many facton? which influenced Maryland's 
decision to participate in the Management Control Project. 
The most influential were anticipated federal budget redactions 
and a report by Maryland's attorney general, suggesting a 
re-examination of federal operational areas within Maryland's 
vocational rehabilitation program. These two major factors 
occurred virtually simultaneously and substantial efforts 
were taken within the agency to address them. 

In regard to anticipated federal budget reduction, tho 
agency established three planning groups to assess all agency 
operations. These groups included: field services, personnel, 
and the Maryland Rehabilitation Center (a comprehensive 
evaluation and training facility operated by the agency) . 
These groups quickly examined all aspects of their operations 
and recommended program reductions based on the projected 
decreased budget. A final consolidated set of recommendations 
submitted to the Maryland State Board of Education was approved 
in June of 1981. The result of this effort was a staff 
reduction of 850 to 722. The method used to achieve this 
reduction was based on seniority; a great number of staff 
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were demoted in pay and/or forced to relocate and/or take 
over new caseloads. A few senior staff retired and several 
high level administrative positions were filled with new 
staff. 

As the agency prepared for the staff reduction, it also 
established task forces to address the operational issues 
identified by Maryland's attorney general. These task forces 
included: (1) state plan, (2) priority of services, (3) data 
processing, (4) cooperative agreements, (5) eligibility/ 
ineliqibility, (fi) quality assurance, (7) agency forms, and 
(8) affirmative action-consumer affairs. 

In the process of performing their specific charges, 
these groups collected information relative to what other 
states were doing about similar issues. The information 
gathered indicated there were substantial efforts being 
undertaken to improve the quality of services provided to 
handicapped persons. In formulatinc, their final recommen- 
dations, it was clear that the u .rust of all prograio. efforts 
would neea to focus upon improving the quality of services 
provided to the handicapped population in Maryland. 

In line with this emphasis upon improved quality 
services, the quality assurance task force had acquired In- 
formation concerning the Management Control Project. This 
pilot project offered Maryland the opportunity to receive 
assistance in working toward improving quality servicea and 
increasing professionalism of its staff. 
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B. Oraanized "ro.i* ct activities 

Project Development 
In early July, 1978, four task groups were designated to 
begin designing the new management system. Representation 
included the Rehabilitation Services Administration, Georgia 
Division of Vocational Rehabilitation personnel (both super- 
visory and counselor levels) , and the Rehabilitation Counselor 
Training Program personnel from the University of Georgia. 
In approaching their respective assignments, the task force 
groups made the following assumptions: 

1. Statutory requirement of the 1973 Rehabilitation 
Act and its amendments must be met; 

2. The mechanics of the project must fit into the 
on-going services delivery concept; 

3. All eligible applications must continue to be served; 

4. Information data obtained for the Management Control 
Project must be congruent with the reporting system 
requirements; and 

5. An increase in paperwork should be avoided. 
Assignments were as follows: 

1. Experimental Design Task Group 

a. Select the experimental area and a suitable 
area for comparison purposes; 

b. Develop measurement criteria and select the 
appropriate instrumentation; 

c. Develop standards and the appropriate intervals 
for collecting pre- and posttest measures; 

d. Write a description of the experimental design 
component of the project. 

2. Personnel Task Group 

a. Develop competency statements for rehabilitation 
counselors at the dependent and independent 
levels of functioning. Determine whic' of these 
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competency statements are job related requirements 
and which relate to professional functioning; 

b. Develop a mechanism for measuring and determining 
the level at which counselors are functioning? 

c. Develop a proposal that would provide Merit System 
support for the experimental district to implement 
an independent and dependent system with the 
flexibility of moving personnel between these 
statuses if their job performance so warrants. 

3. Casework Process Task Group 

a. Review existing casework process requirements 
and statistical reporting requirements and 
eliminate those that are incoiapatible with the 
management control system; 

4. Standards Task Group 

a. Develop the standards against which district 
performance will be measured in the implementation 
of the project; 

b. Develop a system of Management by Object! vgs 
format for achieving counselor concurrence with 
the district standards and a clear statement 

of standards against which the counselor will 
be evaluated. 

The four task force groups attempted to set aside the 
present system of rehab ilitati'-^n management and process, 
and focus their attention on the development of standards 
that would attack the problem areas identified, i.e., (a) 
ineligible clients being served, (b) insubstantial services 
provided clients, and (c) unsatisfactory outcome results. 
Essentially, each task group sought to determine the basic 
requirements of the rehabilitation leqislation and develop 
a simple system to accommodate those requirements. Sequentially 
the process included: (1) development of the standards; 
(2) development of a casework model; and (3) development 
of a research design to measure the proposed standards. Five 
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performance standards were developed and approved by the 
steering committee. Each standard was developed with the 
assumption that all eligible clients applying for rehabili- 
tation services were equally eligible. As the task groups 
designed a system for experimental implementation in Georgia, 
planners of the MCP set forth the following objectives: 

1. To improve the quality of services to all eligible 
disabled persons (especially the severely handicapped) ; 

2. To increase the effectiveness of management approaches 
to quality services; 

3. To decrease superfluous task and process demands 
required of co\anselors in case management; 

4. To develop and field test alternatives to traditional 
modes of case management outcomes; 

5. To assess the overall effectiveness of the MCP as 
an alternate approach to achieving quality case 
outcomes; and 

6. To demonstrate a cost/beneficial outcome by increasing 
independent professional functioning accompanied 

by a decrease in supervisory time. 

The task groups agreed upon these objectives and selected 
an experimental area (one of the eight administrative geographic 
districts in the Georgia agency) for pilot implementation. 
The experimental area was selected early in project planning 
in order to allow experimental staff to participate in design- 
ing the project and implementing the system in a pilot phase. 

During the planning phase performance standards were 
developed with criteria for measuring accomplishment of the 
standards (see Appendix A) . Levels of performance were set 
for independent functioning. Casework requirements Wf?re 
reviewed and those requirements considered incompatible with 
MCP philosophy were eliminated. Simplified casework process 
forms consistent with revised process requirements were developed 
"Pretest" and "posttest" dates were selected and it was decided 
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that performance would be measured according to the newly 
developed standards. 

The following three basic objectives guided the develoi?ment 
of a research methodology and design for evaluation of 
the project: (1) to produce objective, meaningful results; 
(2) to keep additional data gathering in the experimental 
and control districts at a minimuui; and (3) to test out 
a new supervision (management control) system without disrupt- 
ing the normal delivery of vocational rehabilitation services 
to clients. 

The East District of the Georgia DVR agency was selected 
as the experimental region for three basic reasons: (1) the 
East District was of ten designated as the experimental region 
for innovative concepts by the parent DVR organization and 
the Department of Human Resources; (2) the East District 
was representative of a typical VR district in geographical 
area, population, urban-rural configuration, community resources, 
and types of VR services available; and (3) the close prox- 
imity of the University of Georgia's Rehabilitation Ccnmseior 
Training Program and the University computer center. An 
experimental district description is located in Table 1. 
Utilizing comparative data from the Georgia DVR agency, the 
Southeast District was selected as the control district. 
This district v;as the most similar in population, resources, 
urban-rural configuration, similarity of caseload types, 
and number of VR counselors. A control district description 
is presented in Table 2. 

Project designers expected that achievement of project 
objectives would have major impact on administration, service 
delivery personnel, and client outcomes of a state rehabilita- 
tion agency. 

It was felt that improvement in agency and administration 
would relate to the development of an organization with a 
goal or product oriented approach consistent with the theoretical 
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Table 1 

General Description of Experimental District 



Basic 

Total Population 528,500 

DVR Caseloads 35 

Population /Caseload 16,515 

Augusta Population 120,000 

Number of Offices 7 



(Largest Metro Area) 



Professional Staff 

Administrative : 

District Director 1 
Augusta 

Assistant District Director 1 
Athens 

Casework Supervisors 3 
Rehabilitation Counselors 35 



Caseload Types (n=35) 
General 

Mental Retardation 
Mental Illness 
Rehabilitation Residence 

(Mental Illness) 
Blind 

Public Offender 
Deaf 

General /Mental Retardation 
Workers ' Compensation 
SSI/SSDI Trust Fund 
Talmadge Hospital 

Facilities 

Easter Seal (Augusta) 
Kelley Workshop (Athens) 
Rehabilitation Residence (Augusta) 
Regional Mental Hospital (Augusta) 

Gracewood Vocational Adjustment Center (Auausta, Statewide) 
Eugene Talmadge Memorial Hospital (Augusta, Statewide) 



10 
6 
3 
1 

2 
1 
]. 
4 
2 
2 
3 



1978 Fiscal vear #26 Closures = 1,176 
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Table 2 



General Description of Control Dis-;:rict 



Basic 

Total Population 
DVR Caseloads 
Population /Caseload 
Savannah Population 
Niomber of Offices 

Professional Staff 

Administrative : 
District Director 

Waycross 
Assistant Distric 

Savannah 
Casework Supervis 

Rehabilitation Coun 
Caseload Types (n=32) 



General 15 

Mental Retardation 8 

Mental Illness 1 

Rehabilitation Residence 1 

(Mental Illness) 

Blind 2 

Public Offender 1 

General /Deaf 1 

Mental Illness/General 1 

General /Epileptic Clinic 1 



Public Offender/Mental Retardation/Mental Illness 1 
Facilities 

Goodwill Facility (Savannah) 
Rehabilitation Workshop, Inc. (Waycross) 
MI Rehabilitation Residence (Savannah) 
Reqional Mental Hospital (Savannah) 



1978 Fiscal Year #26 Closures ~ 1,605 



543,100 

34 (2 vacant) 
15,517 

118,349 (Largest Metro Area) 



t Director 1 

ors 3 

selors 32 
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components of a Management Control System — the statement 
of measurable standards, and the establishment of a reward 
system that embraces work performances, minimum standards, 
and employee motivation. Decreased administrative expense 
was anticipated as a result of the reduction of casework 
recording and record keeping. A subsequent decline in the 
need for statistical data collection, storage, and processing 
was also anticipated. A redeployment of some supervisory 
and clerical personnel into service provision was anticipated 
with the advent of independent functioning counselors and 
the decrease in casework recording and paperwork processing. 

Inherent in the development of a management control 
system was potential benefit to the rehabilitation counselor. 
It was felt that morale would increase as management controls 
were eliminated and the service provider had the opportunity 
to function with a maximum degree of freedom and responsibility. 
The professional status of the rehabilitation employee was 
expected to be enhanced by the freedom to be responsible 
for time, actions, and conseguences of efforts. The assesG- 
ment procedure and instrument designed for the new system 
were vastly improved and could be applied in an equitable 
fashion. Because of performance based assessment procedurr-G; 
personnel assets and deficiencies were expected to be readily 
apparent so that corrective action could be taken as appropriate, 

A major MCP objective concerned the assessment of the 
impact of an outcome-oriented service delivery system on 
the individual client. Anticipated impacts were grouped 
within eligibility determination, the Individualized Written 
Rehabilitation Program, and client outcomes: 

1. Eligibility Determination 

a. More effective information gathering and decision- 
making with regard to eligibility determination. 

b. More extensive analysis and consideration of 
handicapping conditions of disability. 
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c. Increased attention to and consider... tion of 
"substantial handicap to employment" criterion. 

d. Expanded and more relevant utilization of 
extended evaluation. 

e. improved, meaningful client appeals procedure. 

2. Individualized Written Rehabilitation Plan (IWRP) 

a. Improvement in development of intermediate objec- 
tives and planning for related services. 

b. More effective identification and utilization 
of non-VR resources (similar benefits) . 

c. More effective utilization of funding resources 
for client services (fiscal accountability). 

d. Increased client involvement in planning and 
monitoring of IWRP. 

3. Client Outcomes 

a. Placement in jobs easily consistent with the 
handicapping effects of disability, 

b. Increased annual earnings. 

c. Increased client satisfaction with VR services, 

d. Increased numbers of clients terminated from 
public assistance roles, 

e. Expanded and more relevant utilization ol: post- 
employment service 13. 

I nitial Project Implementation 
A four-member external casework review team was selected 
for pre-post project assessment. Team members were selected 
from state rehabilitation agencies outside of Georgia in 
order to reduce bias as much as possible. Interrater relia- 
bility was established and pretest assessment in the ckill 
areas was completed during April, 1979. By this time, the 
entire experimental district staff (managers, counselors, 
and support personnel) was thoroughly oriented and trained 
in the skills area (eligibility, IWRP, financial accountability, 
and closure). Interrater reliability was also established 
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for experimental managers. The project was in a trial imple- 
mentation phase until July 1, 1979 when full installation 
occurred with implementation of the revised casework system, 
project standards, and monthly performance assessment with 
evaluative feedback by internal reviewers (experimental managers). 
Posttest assessment, scheduled for June, 1980, answered the 
following research questions: 

1. Does the management control system have a significant 
positive effect on performance in eligibility determin- 
ation? 

2. Does the management control system have a significant 
positive effect on performance in IWRP development? 

3. Does the management control system have a significant 
positive effect on performance in financial account- 
ability? 

4. Does the management control system have « significant 
positive effect on performance in case closure? 

During the spring of 1979, the National Institute of 
Handicapped Research suggested that project staff closely 
scrutinize the research design and that this could be facil- 
itated through consultation with, experts. Project staff 
recognized the potential for conducting previously unpianneci 
research and also the possibility that research might be 
enhanced by expanding the sample population size. As a result, 
a committee of research and statistical experts was formed 
and brought to Atlanta in order to provide recommendations 
concerning these matters. These recommendations were incorporated 
into a research plan designed to demonstrate the impact of 
the management control system on clients, counselors, super- 
visors, and adn\inistrators. 

The original grant narrative proposed that, given positive 
experimental results, implementation of the project on a 
state-wide basis would begin in July, 1980. During the fall 
of 1979, however, agency management was confronted with serious 
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problems within the orqanization which they felt necessitated 
immediate corrective action. Of major concern were; (1) the 
reduction of state funds resulting in major counselor case 
service budget cuts, and (2) RSA audit results identifying 
deficiencies in eligibility determinations. Planned action 
included the implementation of an order of selection system 
which would assure that case service monies would be available 
for the most severely handicapped clients. Clients not clas- 
sified as severely handicapped or not served by an agency 
having a cooperative agreement with DVR would not be eligible 
for purchased services. To correct deficiencies identified 
through the audit, the agency felt that a major training 
effort aimed at eligibility determination would be essential. 

Implementation of an order of selection and a training 
effort to correct eligibility deficiencies would have had 
a negative impact on the project's research design because 
of its confounding effect. The potential effect was explored 
with the research desicjn committee who after a thorough assess- 
ment, met with aqency administrators to discuss alternative 
plans. Althouah the agency asserted their desire not; to 
negatively impact the research design, it was apparent that 
the experimental and control districts could not bo exclu.i^rl 
from day to day management action. One task of the reaearch 
design coirimittee became the development of project research 
methodology to control for management action which would 
have an adverse impact on the research effort. 

A second meeting of the research design committee retiulted 
in the formulation of a plan control for management action 
adversely affecting the project. The implementation of an 
order of selection was recognized as essential given the 
existing financial circumstances in the Georgia DVR agency. 
We speculate that it has had a neqligible impact on the 
research design. It was felt that training on eligibility 
deterir.ination conducted by the agency would be influenced 
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by previous project traininq in the experimental district. 
Thus we could anticipate a negative influence on the comparison 
of the experimental and control districts as well as an impact 
on our training module design should state-wide implementation 
be a reality in July, 1980 and the control district receive 
training prior to scheduled posttesting. 

The research design committee recognized the opportunity 
to greatly enhance the credibility of the research design 
by: (1) increasing the population size and gathering data 
similar to that being collected in the experimental and control 
districts; (2) expanding research areas to be studied; (3) 
demonstrating the capability of a state agency to implement 
such a system with existing resources; (4) maintaining the 
experimental and control districts as originally planned 
in spite of management action which had the potential of 
severely damaging project research efforts; and (5) increasing 
the time available to observe the system in place without 
chanaina the research design as approved by the grantor. The 
committee further suggested that the agency might be receptive 
to participating in the research effort on a state-wide basis 
due to recent audit findings and other problems identified. 
If the plan were accepted by the agency, it was the consensus 
of the research design committee that "the oroject has the 
potential of beinq the most credible research effort we've 
experienced in an R&D nrant, one which could have an exciting 
and postive influence on the rehabilitation movement." 

In a meeting held with agency executive staff, project 
staff presented a thorough orientation of the agency commitment 
required for state-wide expansion of the project, a complete 
explanation of research that would be collected, and a review 
of progress in the experimental district. Results of two 
interim experimental case reviews conducted by project reviewers 
indicated that performance in these areas had increased sub- 
stantially. An additional state-wide case audit, independent 
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of the MCP, indicated that MCP cases appeared to be sufficiently 
documented and superior to other cases external to the experi- 
mental district. In consideration of these factors, a decision 
was made by project staff and agency administration to staqger 
project training and implementation by district over the 
period January 1, 1980 through June 30, 1980. The control 
district received training in June and was thus maintained 
as a control for the period originally designated. This 
plan allowed for comparison of results in the experimental 
situation and for demonstrating the efficiency and effective- 
ness of the management control system in an entire agency. 

Statewide Project Implementation 
A training team composed of experimental district managers 
and counselors, project staff and university personnel, and 
agency state office staff completed management control system 
training for all agency field managers and counselors in 
June, 1980, The director of a rehabilitation counselor education 
program assessed the training program as it was presented 
to supervisory staff in February, 1980. Following the session 
he spent four hours with the trainers discussing delivery 
and content of material; his comments were very positive. 
Feedback from training participants was generally positi^'o, 
also. The management control system became the official 
method of agency operation Julv 1, 1980 and was reinforced 
by the development of district task forces to assure smooth 
operation. 

As planned, in April, 1980, project staff began training 
supervisors to review and rate case files in an effort to 
establish reliability and validity of case reviews. A state- 
wide pretest case review was conducted by outside reviewers 
in July, 1980, The initial reliability sessions were completed 
in September, 1980 with independent rating of 12 active cases 
and five "08" closures. These ratings were utilized in calcu- 
lating initial reliability and validity figures for supervisory 
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;itaff . Project staff observed that while supervisors could 
easily detect and aqree that a case file contained appropriate 
documentation, they were unable to aqree and often inaccurate 
in determining the lack of appropriate documentation. An 
unanticipated result of the initial attempt to establish 
reliability and validity was the recognition that part of 
the inability to agree and rating inaccuracy resulted from 
agency policy which lacked clarity, contained conflicts, 
and was open to varying interpretations. Agency administration 
took a close look at the body of policy and instituted a 
system for rewriting the entire policy manual in order to 
eliminate the problems noted above. In addition, this led 
to the development o^ a quality analysis unit in the state 
office and a project updating and revision of standards 
with guidelines for reviewing case files. 

In order to insure consistency with project philosophy 
and standards, Georgia casework forms (application for services, 
pre-printed aareement of understanding, and IWRP) were revised 
to reflect a reduction of items and simplified language. 
Edit checks on authorizations and invoices were computerized 
and reduced so that staff time was saved and a vendor could 
be paid within one week of invoice submission. The greater 
efficiency in authorization and invoice turn around led 
to adoption of the edit check system by the Georgia Department, 
of Human Resources. 

Expanding Project Support 
Following statewide system installation in Georgia, 
project staff concentrated their efforts on maintenance activi- 
ties with the Georgia agency, increasing project visibility, 
and interacting with other state/federal rehabilitation agencies 
interested in pilot testing the management control system. 

Activities with the Georgia agency from September, 1980 
until March, 1981 centered on assisting with the development 
of policy consistent with manaaement control system philosophy. 
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The eight assistant distr-^ct directors were a53iqned the 
task of develooinq a new policy manual and, at the same time, 
were given the role of assuring quality casework in their 
districts. In conjunction with the new role, project staff 
concentrated time and effort with this group to develop 
reliability and validity in the case review process. An 
in--depth understanding of and skill in case review was expected 
to assist this group in writ:ing policy which a counselor 
could easily interpret and utilize in rehabilitation activities 
and documentation of those activities. 

The narrative description of the project was updated 
in July, 1980 and sent to a] 1 state directors, all rehabilita- 
tion counselor training progr.vin coordinators, RSA and NIHR 
officials, and other interested parties. Requests for it 
were numerous and reactions were extremely positive. The 
first project newsletter was reprinted because of great demand. 
The development of the counselor training manual continued 
and the manual was shared with Reqion IV rehabilitation 
educators for their input. 

Project staff met with Case Review Schedule project 
staff and shared experiences and conclusions based on many 
case reviews, particularly reviews of the same cases in Nevada, 
Recommendations were made as requested by the CSAVR Clienc 
Services subcommittee which met with staff from both projects 
in September, 1980, The project recommendations were discussed 
by telephone conference with the full committee and parts 
were incorpor*? ted into policy recommendations and eligibility 
recommendations developed by committee members « The re.9ult 
was three recommendation Dapers presented to the CSA'^^'R executive 
committee. 

A statewide casework posttest was conducted in June, 
1981. Results indicated that project implementation resulted 
in great improvement on all criteria of the project process 
standards. The outside review team found that cases meeting 
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the eligibility standard had increased by 35%. Increases 
in meeting IWRP criteria ranged from a minimum of 40% to . 
a maximum of 74%. It should be noted that the changes 
represented both an increased compliance with regulation/ 
law and increased casework documentation of accurate decision- 
making, substantial interaction with clients, and appropriate 
plaT-ning and spending. 

Project Implementation in Michigan and Maryland 
The project director secured commitment from Michigan 
and Maryland VR agency directors to fully implement the 
management control system on an experimental /control basis. 
Administrative commitment was secured in Michigan on Septem- 
ber 1, 1981 and in Maryland by December 15, 1981. 

In both agencies an organizational analysis was completed. 
This included a study of the role and function of agency 
personnel and a complete review of policy and forms with 
suggestions for revisions, as appropriate. Satisfactory 
revisions were made in both states, including a complete 
revision of the J'i:'^higan policy manual and the development 
of a new policy manual in Maryland. Each agency developed 
a unique outcome measure which is consistent with agency 
operation and goals. 

Pretesting of casework on the process standards was 
completed in Michigan during the week of September 21, 1981 
and in Maryland during the week of January 11, 1982. Georgia 
Division of Vocational Rehabilitation personnel functioned 
as outside reviewers in both states after demonstrating 
a high degree of reliability and validity in the case rating 
process. 

Administrative training was accomplished through a 
series of seminars regarding the conceptual development 
of the project, project philosophy, and technical operation 
of the management control system. A week of training in 
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the application of project standards and criteria to case 
review was conducted in Michigan in November, 1981 and in 
Maryland in February, 1982. Participants were experimental 
first-line supervisors, and personnel responsible for super- 
visory performance and quality assurance. Project staff 
observed steady improvement in bcth states but have found 
that the development of reliability and validity among case 
reviewers is a difficult and time consuming task. 

Training for experimental staff and other selected 
personnel (personnel responsible for policy, quality assur- 
ance, field services, etc.) was conducted in Michigan during 
December, 1981 and in Maryland during March, 1982. Project 
staff closely monitored feedback and provided assistance 
and reinforcement. Follow-up trips were conducted on a regular 
basis (eight to ten week intervals) to continue to develop 
reliability and validity of reviewers and to provide consulta- 
tion as needed to counseling staff and agency administration. 
Extensive time has been spent in both states assisting personnel 
in developing the ability to take over the monthly reporting 
on casework process performance and to continue to work with 
case reviewers and measure reliability and validity. 

Final posttesting was conducted in Georgia in June 1982, 
providing a two year follow-up period; in Michigan during 
September, 1982, providing a nine month follow-up period; and 
in Maryland during October, 1982, providing a seven month 
follow-up period. Each state was provided an extensive report 
of results and project recommendations for future system 
utilization. 

Project Forum 

As part of the final phase of the R&D grant, a forum 
was held involving MCP pilot states, RSA, ar NIHR. A planning 
task force representing the three pilot states was charged 
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with the development of a program which would achieve the 

following objectives: 

1. To disseminate information and research findings 
regarding the Management Control Project; 

2. To continue investigation and evaluation of 
the management control system as an alternative 
to traditional agency management systems; 

3. To share experiences of project participants 
as a means of contributing to future project 
utilization efforts; and 

4. To form a coalition of participating MCP states 

to provide mutual support and continued dissemination 

of project information. 
Rehabilitation counselors, managers, and administrators 
from the pilot agencies, representatives of RSA regional 
offices and NIHR, and project staff met in Atlanta on 
November 3-5, 1982. Pre-forum assignments had been given, 
an orientation provided to facilitators and recorders, 
and work group assignments made. Major issues discussed 
were : 

1. Overview of Management Control Project Research 
and Demonstration Findings; 

2. The Effects of the Project on Agency Stafi'; 

3. The Effects of the Project on Agency Clientele; 

4. Organizational Prerequisites for Effective Manage- 
ment Control Project Implementation; 

5. Elements of an Effective Management Control System 
Implementation and Maintenance Plan; and 

6. Effective Utilization of Management Personnel lor 
Operationalizing the Management Control System. 

A forum topic agency i^ found in Appendix B. 



ERIC 



58 



BEST COPY miUlBLE 



Problems Encountered 

During the project period, minimal problems were 
encountered. Fortunately, through the flexibility given 
an R&D grant, expert advise from NIHR and a research design 
committee, and the problem- solving skills of project staff, 
problems encountered became advantages resulting in a highly 
creditable research design and a much improved management 
system. A few initial ideas were discarded due to a lack 
of interest and support from pilot agencies or due to a 
grant period insufficient for the collection of meaningful 
data. Other ideas were tested and found to have little 
or no effect on performance or client outcome. Finally, 
exploration of a systems approach to the management of rehab- 
ilitation service delivery in a field setting has given 
project and staff the opportunity to demonstrate the adapt- 
ability of the management control system to organizations 
which operate within a constantly changing environment. 
The following areas reflect major issues requiring adjustment 
during the grant period. 

Staff Time . The design of the Management Control Project 
has required extensive and ongoing staff involvement in 
three state agencies. Initially, it was felt that implemen- 
tation of the management system to be demonstrated by the 
project would require five fairly simple stages: 1. explan- 
ation of the system to management; 2. pretesting? 3. counselor 
training in the application of standards; 4. posttesting; 
and 5. analysis of results. Implementation i:^ the Georgia 
agency clearly demonstrated the value of a research and 
demonstration grant. Issues were forced to the front and 
required the attention of both the agency and the project. 
First it became immediately obvious that an organizational 
analysis was essential and extensive preparation of state 
office administration was necessary. It was found that state 
agency policy was a major impediment to successful application 
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of standards. The development of essential managtrnent skills 
was overlooked and the skill level of counseling staff was 
overestimated.. Although the research design remained intact, 
the implementation model changed to address deficiencies 
identified. Extensive preparation of the organization, 
including policy rewriting, became a part of the system's 
implemetation. Management skill development, team building, 
and behavior change were incorporated. Counselor training 
modules were refined to address major performance deficiencies. 
A mechanism to reinforce appropriate behavior became a part 
of the follow-up process. 

The above has placed high demands on project staff. 
It must be noted that staff did not increase while demands 
did. The result required the shifting of some data collection 
and analysis to the end of the project period. 

Reviewer Reliability/Validity . Recognition ot the 
difficulty of developing and maintaining reliability and 
validity in the case review process has been slow. The 
need for supervisory training in the case review process 
was first recognized during statewide management control 
system training in Georgia. A total of 2k days of training 
was planned and provided. Results were not encouraging? 
project staff found that individual supervisors were assessing 
the same information in many different ways and with varying 
degrees of accuracy. At that time the need for clear and 
definitive policy was recognised and planning for rewriting 
the Georgia manual of policy began; the policy rewriting 
process was implemented by the eight assistant district 
directors who were designated to have quality assurance 
responsibility in their districts. It was felt that the 
key to clear policy was found in understanding the application 
of policy to casework. Because of this, project staff spent 
ten days over a four month period workincr with this group 
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during the initial phases of policy development. Many cases 
were reviewed and many reliabil ity /validity studies were 
completed. Although reliability and validity were raieed, 
project staff still felt that a minimum level had not been 
reached. 

As a result of the experience in Georgia, project staff 
assured that policy was clarified and appropriate policy 
changes wero made prior to any training efforts in Michigan 
and Maryland. A full week in each agency was devoted to 
training on the review process. Based on results of that 
training effort, it has been demonstrated that one week 
of training improves reliability and validity but is not 
sufficient to bring reliability and validity to a minimum 
level of acceptability. Major advances have been made, 
however, additional training and research is necessary before 
acceptable levels of performance can be reached. 

Preparation for MCP Implementation . Project planners 
were initially unaware of the degree of organizational change 
which a state agency must undergo in order to implement 
the system prescribed by the Management Control Project. 
Project implementation within the Georgia agency demonstrated 
the effects of putting a management control system in place 
without consideration of necessary organizational changes 
and/or attentions. Project staff capitalized on the Georgia 
experience to assure that similar problems were not encountered 
in the Michigan and Marylt?nd agencies. This awareness resulted 
in a much smoother implementation and allowed the total 
system to be demonstrated. 

Very little organizational analysis was done prior 
to implementation in Georaia. Extensive organizational 
analyses were completed in Michigan and Maryland with emphasis 
placed on the state policy system and the quality assurance 
system. With the project's assistance, Michigan revised 
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their policy manual while the Maryland manual was completely 
rewritten. After participating in both experiences, it 
is the project's opinion that a manual rewrite is a more 
effective method. However, it is recognized that this is 
dependent on policy in place within an individual state 
agency . 

Project experience in three pilot states, as well as 
review of several other programs, reveals a lack of effective 
and efficient quality assurance systems. First, the structure 
of a system is not in place and second, personnel have not 
been prepared to provide reliable and valid feedback to 
staff regarding their performance. 

A third area requiring change within participating agencies 
has been the roles and functions of some staff at both the 
state office and field service levels. This has been accom- 
plished with minimal disruption in our pilot states. 

Preparation time becomes a factor which must be considered 
as an implementation timetable is developed. A thorough 
organizational analysis can be completed, with the exception 
of policy review, in five days on site. Policy review is 
time consuming; it generrlly takes a minimum of two to three 
weeks. The rewriting of policy is much more time consuming, 
Georgia elected to involve the entire agency in this task 
and it took approxiraatelv eight months to complete. Michigan 
and Maryland assigned the responsibility to an individual, 
and the task was completed in less than two months. 

Preparation of those who have responsibility for apprais- 
ing counselor performance represents another major time 
segment. The project's methodology in Georgia demonstrated 
complete ineffectiveness. In Michigan and Maryland the 
project was able to demonstrate a more effective model which 
combined intensive performance analysis training with follow- 
up individual and group activities. While this method is 
much more effective, it needs additional refinement. 
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Program Funding Cutbacks . Although there are dis- 
advantages to experimentation in a field setting rather 
than a laboratory setting, the project has had the oppor- 
tunity to confront real problems experienced by agencies. 
The system has proven to be effective under real circum- 
stances and has passed a superior test. 

The project has experienced the real world since its 
beginning. For example, on the first day of counselor 
training in Michigan, it was announced that one of our pilot 
offices would be closed. This resulted in employees being 
displaced, some losing their jobs, others bumping into new 
positions, and extreme staff anxiety. Maryland went through 
a very similar experience prior to project implementation. 

Project staff provided additional training in Michigan 
to maintain the four pilot offices and did their best to 
deal with staff anxiety throughout the implementation process. 

Although these problems were not desired, they provided 
the project with valuable experiences and further demonstrated 
the adaptability of the management control system. 

Personnel Skill Level /Attitude Toward Change. The 
following presents two problems not anticipated at the project's 
onset. The project descriptions discuss a highly skilled 
professional providing rehabilitation services to handicapped 
citizens. Project staff have found that the degree of exper- 
tise at the counselor level and at the supervisory level 
varies tremendously. In developing training modules for 
the counselor level, the project had to revise training 
materials and format substantially in an attempt to deal 
with skill deficiencies. At the supervisor level, it was 
necessary to increase emphasis on management behavior and 
management leadership skills. Management skills in the 
rehabilitation process received greater than anticipated 
emphasis. Agency administrators have been made aware of 
the need for consequences when poor performance persists. 
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Required performance change and the acquisition of necessary 
management skills will take longer than initially anticipated. 
Originally it was felt there would be positive response 
to the management control system by counselors and managers. 
The system received acclaim by the National Rehabilitation 
Counseling Association and correspondence from counseling 
groups was extremely encouraging. Actual implementation 
can be threatening to both counselors and managers. The 
system clearly pinpoints performance deficiencies as well 
as good performance. It requires management to acquire 
skills which are also regularly assessed. 

Incentive Pay . The project was unable to investigate 
the relationship of supplemental pay to counselor performance 
due to delays in receiving approval from the Georgia State 
Merit System. Necessary rulings and approval were given 
by the Office of Attorney General, the Department of Human 
Resources, and the Office of Planning and Budget. The State 
Merit System delayed their approval due to legitimate problems 
identified in the proposed case weighting system. They 
were supportive of the incentive pay concept and agreed 
to work with project staff and the Georgia agency in developing 
an equitable system of rewarding exceptional counselor per- 
formance. 

Agreement on an appropriate award system has now been 
reached but sufficient time was not available for the project 
to demonstrate the system adeauately and report creditable 
results. The Georgia agency maintained a commitment to 
investigate the effectiveness of incentive pay and developed 
a special project within the agency. Once results are obtained 
they will be reported to the rehabilitation community. 

Independent Counselor Status . Awarding independent 
counselor status has been delayed in the pilot agencies 
until managers responsible for performance reviews reach 
an acceptable level of reliability and validity. The project 
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continues to maintain that a mechanism for attaining and 
awardincT independent counselor status is important from 
a management efficiency standpoint and as a counselor performance 
incentive . 

Five Status System . The project' -3 first continuation 
request (approved effective 7-1-79) p. -»osed a new status 
format. This reduced the current 16 & dtus reporting system 
to a more compacted system of statuses. The proposed system 
of status reporting was as follows: 

Status 1 - Referred/Applicant Status 

Status 2 - Extended Evaluation Status 

Status 3 - Service Delivery Status 

Status 4 - Closed Rehabilitated Status 

Status 5 - Closed Non-Rehabilitated Status 
The project received approval from RSA to demonstrate tho 
five status system in the Georgia experimental district. 
Demonstratica did not go beyond the experimental district 
due to : 

1. Federal waivers of certain reporting requires, -n t.... 
were not sought; 

2. The capacity of the agency's compute.; system was 
not sufficient to assess the effects of a five 
status system; ;.\nd most iinpor Lantly , 

3. There was not sufficient interest from personnel 
within the experimental district or state to 
continue demonstration. 

Case Weighting System. The case weighting system did 
not prove to be an effective measure of counselor productivity. 
The "ideal" closure was to be competitive rather than non- 
competitive; it was to be above minimum waqe rather tliaii 
below; it was to have been a case drawing public assistance 
rather than not; and it was to have cost less than $100 
in case service exoenditures. Such a system became difficult 
to implement as many problems result when these definitions 
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are applied to real cases. Secondly, a major question of 
equity exists when applying this type outcome measure. 

In light of these and other problems, several changes 
were instituted. Competitiveness was dropped as a weighting 
factor and income was given priority position and redefined 
into five levels of weekly income. The factor of public 
assistance was brqadened to include a measure of severely 
handicapped in an effort to identify the more difficult 
cases. Expense was redefined to be greater or less than 
$225 representing the state (Georgia) median for FY '80. 
A weighting system was developed consistent with the above 
agency values which resulted in 30 closure types. 

Although the revised weighted closure system was much 
improved, we found that the development of such a quanity 
measure was of more interest to university personnel than 
than state agency personnel. Following review of the revisGd 
system by the MCP Steering Committee, it was recommended 
that a task force on counselor performance be established. 
This task force included counselors, first line supervisors, 
and middle manaaement from the Georgia DVR agency. They 
were charged with development of recommendations Ecr: 1, 
measurino counselor performance according to the ^onr process 
standards developed bv MCP and, 2. aporopriate outcome measure. 
After review of the proposed weighted closure system, the 
task group recommended against its implementation,. Agency 
administrators have not played a strong advocacy role. The 
system therefore, died due to lack of i.iterest. 

Although the proposed weighted closure system has not 
been implemented in any project states, its influence is 
apparent. Philosophically, the MCP stresses the importance 
of agency expectations being communicated clearly to the 
counseling staff. The MCP also sugaests that agency adminis- 
tration has the riaht and responsibility to establish values 
in accordance with its mission. The project's work on an 
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outcome measure has accomplished this and we find closure 
expectations being clearly communicated. 

Agency Policy. The effects of the management control 
system on agency policy have been great. Following the 
project's initial traininq effort with Georgia agency super- 
visors, an acceptable level of reliability and validity 
could not be reached. It was immediately obvious that a 
part of this problem resulted from policy which was vague 
in places, conflicting in places, and often open to varying 
interpretations. As a result of this experience, the assess- 
ment of agency policy is compiated as part of the project's 
organizational analysis. 

Grant Time Constraints . Of major concern to project 
staff has been the inability to collect meaningful data 
within the time period of the R&D (,rant. This hafc; resulted 
in several critical research guestions remaining unanswered. 
vSince the majority of cases affected by the installation 
of the management control system in the pilot states have 
not reached a closure status, it is impassible to provide 
creditable data concerning the relationship of counselor 
performance to client outcome or the effect of the system 
on expenditures per client case. The pilot agencies aie 
aware of this deficiency and plan to have their respective 
research sections analyze appropriate data after a sufficient 
time has passed. Project staff hope to assist in the analysis 
at that time. 

The majority of the issues reported in this section 
have strengthened the management control system demonstrated. 
The oroject emphasis on the analysis of an organization 
prior to system implementation, resolving questionable practices 
and undefined roles, policy development, effective management 
of organizational change and process analysis skills are 
strong components of the system rather than problem areas 
as initially identified. 
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0. Results and Discussion 

Performance on Process Standards 

Results of case reviews completed by reviewers external to 
each state are presented in Tables 3-9. In each instance, 
the most recent counselor casework was selected for review. 
In all reviews cases were randomly assiqned to reviewers. 

Chi- square tests of homogeneity were used in ali analyses 
due to the categorical nature of the data. A chi- square 
test was performed for rater responses to each criterion 
on every case (case closure criteria were considered seperately) , 
The same cases were involved in two tests (cases in status 
08) or ten tests (active cases) thus creating a problem 
of interpretation because these various tests on the same 
case are not independent. A procedure for interpreting 
several chi-square tests performed simultaneously despite 
correlations among the test statistics is described in Jensen, 
Beus, and Storm (1968) and was utilized. Each test statistic 
was compared with a critical point from the distribution 
of the appropriate Bonferonni chi-square statistic which 
depends on the number of tests involved and the degrees of 
freedom of each. 
Pretest Results 

Pour employees from the Mississippi and North Carolina 
rehabiliation agencies formed the "outside" review team 
for case reviews in Georgia. These reviewers wera thoroughly 
trained on project standards and the utilization of the 
rating form (Appendix C) . Rater consistency was established 
at 85% in Feburary, 1979. Results of their pretest review 
of cases from the experimental and control districts is 
presented in Table 3. There are no significant differences 
between the two districts with the exception of Case Closure 
Criterion A, rationale for closure, on which experimental 
counselors performed significantly better than control 
counselors. 
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Table 3 

Georgia Performance Data* 
Experimental-Control Comparison 
Pretest 



Experimental Control 



ELIGIBILITY 

A. Evidence of comprehensive 
diaonostic study 

B. Description of vocational 
handicap 

C. Rationale for reasonable 
expectation 

STANDARD SCORE 

I'JRP 

A. Rationale for vocational 
aoal 

B. Objectives/services 
consistent with vocational 
handicap 

C. Time frames -For services 

D. Measurable evaluation 
criterion for each 
ob-iective 

E. Evidence o^" client 
involvement 

STANDARD SCORE 

ENANCIAL ACCOUNTABILITY 

A. Only necessary 
exDenditures 

B. Consideration/utilization 
of similar benefits 

STANDARD SCORE 

ASE CLOSURE 

A. Rationale ^or closure 

B. Written notification of 
riahts 

STANDARD SCORE 



3-79 
(n=84) 

79% 

63 

57 

65.7% 

46 
52 

50 
4 

55 

41.4% 

43 

46 

44.5 

(n=88) 
78 
42 

74.4% 



4-79 
(n-79) 

79% 

60 

54 

63,6% 

45 
50 

49 
1 



54 



39.9% 

37 
45 

41 

(n=84) 
62 
40 

59. 8% 



Chi-Sar. 
Value 
df-1 



Significance 



.09 



.12 



.07 
.05 

.01 

,03 

.00 



.40 



.01 



15.64 
.04 



ns 



ns 



ns 



ns 
ns 

TIB 



ns 



ns 



.01 

ns 



'ercentaaos represent cases which met the criteria. 
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A counselor, a first-line supervisor, and a quality 
assurance specialist from the Georgia rehabilitation agency 
formed the "outside" review team for Michiqan case reviews. 
These three people had been involved in the management control 
system in Georgia and, in additior>, were trained in case 
review by project staff. Interrater reliability was calculated 
as suagested by Winer (1971, p. 285) and was at least .80 on 
each process standard. For each counselor, the four cases most 
recently placed in "08" status were chosen for review.* As 
Table 4 demonstrates, results of the pretest case review indi- 
cated that there were no significant experimental-control 
differences on any of the performance criteria. 

Three assistant district directors from the Georgia 
rehabilitation agency formed the "outside" review team for 
Maryland case reviews. They were thoroughly oriented +-o the 
management control system and interrater reliability (Winer, 
1971, p. 285) was found to be at least .85 on each process 
stand; -d. For each counselor, the four cases most recently 
placed m service status and the two cases most recently 
placed in "08" status were chosen for review. Table 5 
presents pretest results which demonstrate no significant experi- 
mental-control differences. 
Posttest Results 

Hypothesis 

The experimental district will perform at a significantly 
higher level than the control district on the case review 
of the process standards (eligibility, ineligibility, IWRP, 
financial accountability) . 

At posttest (see Table 6) Georgia experimental district 
counselor performance was rated significantly higher than 
control district performance on all criteria except Eligibility 

*In all instarces the most recent casework was selected to 
qain as accurate a view as possible of counselor performance. 
In addition, in all instances, the sample was the largest 
number of cases the project could afford in terms of reviewer 
expense. 
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Table 4 

Michiqan Performance Data* 
Experimental-Control Comparison 
Pretest 



Experimental Control Chi-Sauare Significance 



ELIGIBILITY 

p. Evidence of comprehensive 
diaanostic study 

P. Description of vocf.tional 
handicao 

C. Rationale for reasonable 
expectation 



IWRP 
A. 

B. 

C. 
D. 

E. 



STANDARD SCORE 



Rationale for vocational 
qoal 

Ob -iectives/ services 
consistent with vocational 
handic? D 

Tine frames for services 

Measurable evaluation 
criterion for each 
obiective 

Evidence o^" client 
involvement 

STANDARD SCORE 



FINANCIAT. ACCOUNTABILITY 

A. Only necessary 
exoenditures 

B. Consideration/utilization 
of similar benefit 

STANDARD SCO'.ll^ 

CASE CLOSURE 

A. Rationale for closure 

B. Written notification of 
rights 

STANDARD SCORE 



9-81 
(n=172) 



78.5% 

44.2 

36.1 

51. '16% 

29.1 
25.0 

16.3 
23.3 

29.7 
25.82% 

34.9 
33.9 

34. 50% 

(n 400) 
54.0 
72.0 

53. 50% 



9-81 
(n='145) 



80.7% 

38.6 

35.9 

50.32% 

30.3 
26.9 

24.1 
26.2 

30.3 
28.05% 

33.8 
33.8 

33.80% 

(n=98) 
51.0 

79.6 
58.15% 



Value 
df-1 



.234 



1.003 



.001 



.061 
.149 

3.051 
. 369 

.018 



.041 
. 001 



.176 
2.263 



ns 



ns 



ns 



ns 

ns 

ns 
ns 



ns 



ns 



ns 
ns 



O 'entaqes represent cases which met the criteria 
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Table 5 

Maryland Performance Data* 
Experimental-Control Comparison 
Pretest 



ELIGIBILITY 

A. Evidence of comprehensive 
diagnostic study 

B. Description of vocational 
handicap 

C. Rationale for reasonable 
exDectation 

STANDARD SCORE 



IWRP 
A. 

B. 

C. 
D. 

E. 



Rationale for vocational 
noal 

Ob T ec t ive s / service s 
consistent with vocational 
handicap 

Time frames for services 

Measurable evaluation 
criterion for each 
ob-'iective 

Evidence of client 
in vol vement 

ST/J^DARD SCORE 



FINANCIAL ACCOUNTAfllLITY 

A. Only necessary 
expenditures 

B. Cor>sideration/util ization 
of similar benefits 

STANDARD SCORE 

CASF, CLOSURE 

A. Rationale for closure 

B. Written notification of 
ricthts 

STANDARD SCORE 



Experimental 
1-83 
(n=14a) 

70. 3% 

14.9 

13.5 

31. 0% 

13.5 

12. 2 

4.7 
10. 8 

10. 8 
10.4% 

12.8 
13.5 

13. 2% 
(n=74) 

64. 9 
62.7 

64. 5% 



Control Chi-Sauare Siqnificance 



1-82 
(n=133) 

75.9% 

21.1 

20. 3 

37.3% 

18.1 
18.1 

9.0 
16. 5 

19.6 
16.3% 

20.3 

.18.9 

19.6% 
(n=63) 
46.0 
51 .6 

47. 1% 



Value 
df-1 

1.141 

1.834 

2. 317 



1.089 

1. 907 

2. 048 
1.967 

4. 207 



2. 850 
1.523 



4. 903 
1.743 



ns 



ns 



ns 



ns 
ns 

ns 
ns 

ns 



ns 



ns 



ns 
ns 



♦Percentages represent cases which met the criteria. 
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Table 6 

GeorQia Performance Data* 
Experimental-Control Comparison 
Posttest 



IflLIGIBILITY 

A. Evidence of comprehensive 
diaanostic study 

B. Description of vocational 
handicap 

C. Rationale for reasonable 
expectation 

STANDARD SCORE 



IWRP 
A. 

B. 

C. 
D. 

E. 



Rationale ^or vocational 
aoal 

Objectives /services 
consistent with vocational 
handicap 

Time frames for services 

Measurable evaluation 
criterion for each 
objective 

Evidence of client 
involvement 

STANDARD SCORE 



FINANCIAL ACCOUNTABILITY 

A. Only necessary 
expenditures 

B. CorsJderation/util ization 
similar benefits 

STANDARD SCORE 

CASE CLOSURE 

A, Rationale ^or closure 

B. Written notification of 
r inhts 

STANDARD SCORE 



i5^xperimental 
6-80 
(n-99) 



93% 

89 

85 

88.8% 

74 
79 

79 
74 

85 

78. 2% 

71 
84 

77. 5% 

(n-74) 
70 
41 

67.1% 



Control 
6-80 
{n-95) 



87% 

62 
54 

66. 7% 

47 
49 

6 
6 

54 

32.4% 

39 
52 

45.5% 

(n-6 6) 
61 
30 

57, 9% 



Chi-Sauare Sinniticance 
Value 
df=rl 



1.65 
17.10 
20.52 



13.71 
17.33 

13.86 
61.32 

20. 52 



19.03 
21.48 



.04 
20.0 5 



ns 

.01 

.01 



.01 
.01 

.01 

.01 

.01 



.01 
.01 



ns 
.01 



*pf^t-(;ontficfe8 represent cases which met the critGri'H. 
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A and Ca^e Closure A, Both districts improved in providing 
evidence of a coitiprehensive diagnostic study and there was 
little change in the appropriateness of closure rationale* 
Table 7 provides results of the statewide pretest--posttest 
comparison of counselor performance • This was based on a 
15% random sample of counselors for whom the five cases most 
recently placed in service status and the five cases most 
recently placed in "08" status were sampled^ Significant 
improvement on each criterion is demonstrated, 

Michigan posttest results are found in Table 8, The 
review team and sampling procedure were identical to that 
at pretest although the sample size decreased due to counselor 
layoffs in both groups. Large improvement occurred among 
experimental cases on each criterion. Experimental counselor 
performance was significantly higher than control preformance 
on all criteria. 

Table 9 presents Maryland posttest results. The review 
team and sampling procedure were identical to that at pretest. 
Large improvement occurred among experimental cases and these 
cases were found to meet criteria significantly mor^- v^h(-:Li 
than control cases on all criterial except Eligibility^ A ..nc 
Case Closure A and B. Both experimental c'nd control cases 
were found to have improved significantly on these criteria. 

Hypothesis 

The experimental district case files will have signifi- 
cantly fewer pages than the control district ::lient 
case files. 

Collecting data f^r testing this hypothesis was accom- 
plished during posttjsting through counting the number of 
narrative pages in each case file rated by the outside review 
team during the Georgia experimental /control posttest. Results 
are presented in Table 10. Although the average experimental 
district active case file contained a page less than the 
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Table 7 

Georgia Performance Data* 
Statewide Pretest-Posttesc Comparison 



Pretest Posttest Chi~Sauare Sinnificanc 
7-80 6-82 Value 

(n-190) (n=194) df=l 



El.ir,.IB.T.T.lTY 

A. Evidence of comprehensive 
diaqnostic study 

B. Description of vocational 
handicap 

C. Rationale for reasonable 
expectation 

STANDARD SCORE 

IWRP 

A. Rai:ionale for vocational 

noci 1 

B. Objectives/services 
consistent with vocational 
handicap 

C. Time frames for services 

D. Metisurabla evaluation 
crj-terion for each 

ob i ec t ive 

Evidence of client 
involvement 

f'ThMDARD SCORE 

F L w ^^;( ; 1 1\ ■. , account ab il i ty 

A. On y necessary 
;<()enditures 

B . c.: or t s i d e ra t ion / u t j. 1 i za t: i on 
o?;' similar benefits 

.r;\MDARD SCORE 

c A .(.■. ;! PE 

A. 't). -ionale for closure 

D. 'A'r Iten notification of 
1 iirhts 

STANDARD SCORE 



78% 

51 

42 

56. 0% 

26 
33 

1 
2 

33 

19.0% 

37 
35 

36. 0% 

{n=190) 
82 
5 

74.3% 



89% 

85 

75 

82. 7% 

69 
72 

74 

65 

71 

70. 2% 

75 
73 

74. 0% 

(n=16 2) 
90 
94 

90. 4% 



8.906 
52.555 
43.567 



72.089 
58. 582 

221.851 
174. 947 

55.496 



55. 956 
55.019 



5,153 
279.649 



.05 
.01 
.01 



.01 

.01 

.01 

.01 

.01 



.0.1. 
.01 



.05 

.01 



*[•><.. •e n i-.Kff?s rcoresent cases which met the criteria. 
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Table 8 



Michiaan Performance Data* 
Exoerimental-Control Comparison 
Posttest 

Experimental Control 
10-82 10-82 
(n-145) (n-97) 



Chi-Sauare Siqnificance 
Value 
df-1 



ETiiniBILITY 

A. Evidence of comprehensive 
diaanostic study 

B. Description of vocational 
handicap 

C. Rationale for reasonable 
expectation 

STANDARD SCORE 

IWRP 

A. Rationale for vocational 
aoal 

B. ob-iectives/services 
consistent with vocational 
haiidican 

C. Time frames for services 

D. Measurable evaluation 
criterion for each 
obiective 

E. Evidence of client 
inx/ol vement 

STANDARD SCORE 

FIMAMCIAf. ACCOUNTABIT.ITY 

A. Onlv necessary 
expenditures 

B. Consideration/utilization 
of similar benefits 

STANDARD SCORE 

CASE CI.O.qURE 

A. R,-.tionale for closure 

B. Written notification of 

r iahts 

STANDARD SCORE 



92.4% 
81.4 
78.3 
83. 62% 

73.4 
64. 3 

74. 1 
73.4 

74.1 

70. 85% 

74.8 
78.3 

76. 20% 

(n-104) 
84.6 
92.3 

36.33% 



76.3% 
36.1 
23. 2 
43.65% 

20.0 
16.8 

13.7 
16.8 

20 . 0 
17.93% 

23.2 
22.3 

22. 84% 

(n=73) 
65.8 
76.7 

68.53% 



12.515 



53.331 



70.600 



65. 287 
51.944 

83.409 
73.124 

67.059 



61.3ti3 



72.179 



8.574 
8.601 



01 
01 
.01 



.01 
.01 

.01 

, 01 

. Ul 



.o;i 

.01 



.05 
.05 



*>.,.,rcf;ncar(GS represent cases which met the criteria. JJJ] CQPt h^.- "-'^ 



^ 76 

ERIC " 



61 



Table 9 

Maryland Performance Data* 
Experimental-Control Comparison 
Posttest 



Experimental Control Chi-Square linaificance 
' 10-82 10-82 Value 



ELIGIBILITY 

A. Evidence of comprehensive 
diaanostic study 

B. Description of vocational 
handicap 

C. Rationale for reasonable 
expectation 

STANDARD SCORE 



IWRP 
A. 

B. 

C. 
D. 

E. 



Rationale for vocational 
noal 

Ob -iectives/ services 
consistent with vocational 
handicap 

Tirae frames for services 

Measurable evaluation 
criterion for each 
obiective 

Evidence of client 
m /olvement 

STANDARD SCORE 



FINANCIAL. ACCOUNTABILITY 

A. Only necessary 
ex'oenditures 

B. Consideration/utilization 
of similar benefits 

STANDARD SCORE 



CASE CLOSURE 

A. Rationale -^or closure 

B. Written notification o^' 
riahts 

STANDARD SCORE 



(n=154) 

92.9% 
63.6 
46.4 
66.4% 

41.2 
39.9 

40.5 
38.6 

40.5 
40.1% 

46.4 
41.8 

44.1% 

(n=77) 
90.9 
, 79. 2 

88.6% 



(n=X40) df=l 



92.1% 



5.0 
5.0 



.054 



24.3 45.900 



9.4 48.796 



39.4% 



7.2 44.857 



7.9 40.034 



50. 824 
46.795 



8.6 39.147 
6.7% 

9.4 48.796 

8.6 41.689 

9.0% 

(n=69) 
89.9 .047 
87.0 1.535 

89.3% 



ns 



.01 



.01 



.01 
.01 

.01 
.01 

.01 



.01 
.01 



ns 
ns 



gPj^^"::entaaes reoresent cases which met the criteria. 
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Table 10 

Number of Narrative Pages 
(July, 1980) 



Control 



Active (12-22) Cases 



Closed Cases (08) 



X = 


4.14 


X = 


5. 37 


s = 


2.24 


s = 


3.9 


N = 


105 cases 


N = 


98 cases 




t = 1. 


554 






P > . 


05 




X = 


1.67 


X = 


2.53 


s = 


2.66 


s = 


1.72 


N = 


75 cases 


N = 


76 cases 




t = 17.015 






P < 


.0005 
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average control case, the difference was not significant. 
A significant difference was found, however, in case files 
closed "08" in which the experimental district case average 
was nearly one page shorter then the control district case 
average. Results support the hypothesis for "08" closures 
but not for active cases. 

Hypothesis 

Among experimental district counselors there will be 
a significant negative correlation between expenditures 
per case and performance on the financial accountability 
standard. 

Testing this hypothesis was accomplished utilizing results 
of the experimental case review posttest in Georgia. For each 
counselor a financial accountability stajidard score and average 
expenditure per case were calculated. Table 11 presents the 
results of the correlation of these figures. The correlation 
(r~ -.22) was small and was not statistically significant 
(p= .24). The hypothesis was not supported. 

Hypothesis 

There will be a significant positive correlation between 
performance on the process standards and outcome (total 
number of rehabilitations) in the experimental district. 

Standard scores were calculated and number of rehabilita- 
tions for fiscal year 1980 was obtained for each counselor. 
Table 12 presents the results which fail to support the hypothesis. 
O utcome Measurement; Closuro Weighting 

During initial project development, planners decided 
to develop and test a system which would assign values to 
successful rehabilitation closures. The "best" closure 
represented a client who was engaged in competitive employment, 
who earned more than minimum wages, who had drawn public 
assistance (intended to represent the severely disabled and 
those who relied on public funds for income) and who was 
rehabilitated with less bhan $100 of case service money 
expended. 
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Table 11 

Relationship Between Performance on the 
Financial Accountability Standard and 
Expenditures Per Case 



N = 30 caseloads 

Financial Accountability x = 77.5 

s = 32.7 

Expenditures Per Case x = $ 926. 37 

s = 1,119.37 

r = -.22 
p = .24 



Table 12 

Relationr.iiip of Perforinance on the 
Process Standards with Outcome 
n=30 Caseloads 





Mean 


Standard 
Deviation 


Correlation 
with Outcome 


Probability 


Eliqibil j.ty 


88.8% 


27.3% 


.18 




IWRP 


78. 2 


33,4 


.20 


. 30 


Financial 
Accountability 


77. 5 


32. 7 


.25 


,18 


Outcome 


23 


15. 2 
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A system was developed and applied to data for successful 
rehabilitations in Georgia during fiscal year 1980. Many 
problems arose in the application of the system to real 
cases. Competitive employment is highly related to income 
(noncompetitive employment almost always results in little 
or no salary) ; clients often receive public assistance for 
reasons not related to disability (dependent children, unem- 
ployment, etc.) J it is difficult to get accurate information 
regarding public assistance at closures; case service expen- 
ditures do not represent agency expenditures such as agency 
facility costs, costs of information obtained from agency 
sources; the distribution of closures among counselors is 
not normal; and, the distribution of closure "types" is 
skewed and tri-modal. In addition, the correlation of total 
weight per caseload with number of successful rehabilitations 
per caseload was .95. Based on these findings, the project 
steering committee turned the decision about adoption of 
the system over to an agency task force which decided not 
to implement a closure weighting system in the Georgia ageiicy. 
Neither the Michigan agency nor the Maryland agency decided 
to implement such a system. 

Survey Data 

Results of statistical analyses of survey questionnaires 
are presented in Tables 13-38 . Survey data was collected 
in all states, althouah not all data was collected in each 
state in the same way. For all hyDothesis testing, alpha 
was set at .0 5 as the level which must be reached for results 
to be considered statistically meaningful. 

Hypo thesis 

Counselor perception of amount of time spont in various 
job functions related to process and paperwork tasks 
will be significantly lower in the experimental district 
than in the control district. 
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Testing this hypothesis was accomplished through a survey 
questionnaire mailed to respondents. The questionnaire utilized 
in Georgia is found in Appendix D and the questionnaire utilized 
in Michigan and Maryland is found in Appendix E. 

Table ?.3 presents the results of the Georgia experimental- 
control posttest conducted in June, 1980. Surveys were returned 
by 90% of the experimental counselors and by 87.5% of the 
control counselors. The t-test was utilized to analyze 
results for each subscale with the appropriate formula (for 
equal or unequal variances) utilized after the F-test for 
homogeneity of variances. A significant difference between 
experimental and control counselors' estimates of time spent 
in recording and reporting was not found and the hypothesis 
was not supported. Statistically tests failed :o indicate 
significant experimental-control differences on any of the 
subscales. 

The hypothesis was tested during Georgia statewide 
system implementation by mailing the survey at pretest (June, 
1980) and posttest (June, 1982) to couiiselors in two of the 
Georgia administrative districts. Response rate was 87% at 
pretest and 100% at posttest. Results of analyses of tb^^'se 
responses are presented in Table 14. The hypothesis is net 
supported; counselors report spending significantly move time 
in recordinrr and reporting tasks at posttest than they indicated 
at pretest. Analysis of other subscales of the survey show 
that counselors report spending significantly more time in 
job placement and follow-up activitn - while spending signi- 
ficantly less time in administrative tasks, evaluative tasks, 
and professional/agency development. Although the hypothesis 
is not supported, these results do indicate that following 
system implementation counselors appear to spend more time 
in activities directly related to client rehabilitation. 

The hypothesis was tested in Michigan among experimental 
and control counselors at pretest (October, 1981) and at 
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Table 13 

Perceptions of Time Utilization* 
Georgia Experimental and Control Counselors 
Posttest Comparison (July, 1980) 



Sub scale 


Experimental 
(n='28) 


Control 
(n=28) 


t 


P 




Administration/ 
Supervision 


8.3 


8.0 


-.1768 


.86 




Evaluating 


7.5 


8.3 


.6039 


.55 




Consultation/ 
Referrals 


13.8 


12.6 


-.5513 


.58 




Professional /Agency 
Development 


8.0 


6.8 


-.5660 


. 58 




Client Counseling 
& Placement 


32.4 


34.1 


. 4680 


.64 




Job Placement 
& Follow-up 


13.6 


11.6 


-.7869 


.44 




Recording 
St Reporting 


16.3 


18.1 


.6969 


.49 





•■^Results presented are mean percent of time estimated by 
respondents , 
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Table 14 



Perceptions of Time Utilization 
Counselors in Two Georgia Districts 
One- Way ANOVAa 



Sub scale Time* Mean (% of Time) 



Administration/ 0 10.5 

Supervision 2 7.9 

F = 4.91 
p = ,03 



Evaluating 0 10.0 

2 6.8 

F = 13.03 
p = ,0005 



Consultation/ 0 11.8 

Ref-irrals 2 12.0 

F = ,04 
p = .84 



Professional/ 0 8.<"^ 

Agency Development 2 5."/ 

F = 9.54 
p = ,003 



Client Counseling 0 33.4 

& Placement " 2 33.7 

F = .02 
p = .90 



C'ob Placement 0 9.0 

& Follow-up 2 12.6 

F = 11.34 

p = .001 



Recording 0 ' 17.3 

S( Reporting 2 21.5 

F = 5.64 
p = .02 



*0 = Pretest 

n = 55 

2 = Posttest 

n --= 6 3 



posttest (October, 1982) through an analysia of variance. 
Data was collected by agency staff development personnel 
during office visits. Pretest responses were received from 
100% of experimental and 100% of control counselors. Post- 
test responses were received from 81% of experimental coun- 
selors and 82% of control counselors. Results of analyses 
are found in Table 15 which indicates the F- test for inter- 
action- of time research group. The hypothesis was not 
supported. 

The hypothesis w.'iS tested in Maryland at posttest 
(October, 1982) when surveys were mailed to experimental 
counselors (87,8% response) and control counselors (78% 
response) . Table 16 ]>resents the results which do not support 
the hypothesis, although results indicate that control coun- 
selors report spending significantly more time than experimental 
counselors in professional growth activities. 

Hypothesis 

The experimental /control comparison will show that 
experimental district supervisors spend si' lOif icantly 
more time in development/consultative activities and 
less time in technical /monitoring/interpretation 
activities . 

Testing this hypothesis was accomplished through utilization 
of a survey questionnaire. The Georgia questionnaire is found 
in Appendix F and the Michigan /Maryland questionnaire is 
found in Appendix G. 

The hypothesis was first tested during the Georgia experi- 
mental/control posttest in June, 1980. Responses to mailed 
surveys were received from 100% of both experimental and 
control supervisors. Results, found in Table 17, do not 
lend support to the hypothesis. The only significant subscale 
difference was the area of fiscal duties in which control 
supervisors reported spending significantly more time than 
experimental L,upervisors, 

During Georgia statewide system implementation, the 
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Table 15 



Perceptions of Time Utilization* 
Michigan Counselors 
Two~Way ANOVAS (Interaction Results) 



Subscale 



Pretest 
Experimental Control 
(n=41) (n=40) 



Counseling 
& Guidance 



31.1 



Recording/ 
Report Writing 



22.9 



Overall Planning 
of Work 



9.3 



Placement 



14.9 



Public Relations 
& Outreach 



Professional 
Growth 



4.3 



Coordinating 
Services 



12.4 



Posttest 
Experimental Control 
(n=30) (n=23) 



33.4 



P«.64 
P-.43 



7.2 



F=.35 
p=.56 



8.2 



F=1.75 
p= .19 



29.8 



25.4 25.2 
F=.01 
p=.91 



9.0 



16.1 13.3 
F=l. 24 
p= .27 



5.6 7.3 

P=1.54 
P= . 22 

4.3 4.3 

F=. 59 
p=^.45 



10.8 



♦Results presented are mean percent of time estimated by 
respondents . 



28.5 



27.3 



.8 



18.0 



5.4 



3.3 



9.7 
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Table 16 



Perceptions of Time Utilization* 
Maryland Counselors 

Posttest 








Subscale 


Mean (% of 
(n-:36) 


Time) 
Control 
(n=32) 




t 


P 




Counseling & 


31.3 


33.2 


- 


. 6304 


. 54 




Recording/ 


26.7 


22.6 


1 


. 7483 


.09 




Overall Planning 
of Work 


9.0 


8.7 




. 2544 


. 80 




Placement 


8.9 


11.6 


-1. 


8920 


. 07 





Public Relations 
& Outreach 


5.9 


5.2 


• 




A 0 




Professional 
Growth 


5.1 


7.6 


-2. 


3494 


.03 




Coordinating 
Services 


12.8 


11.2 


* 


9067 


.37 





*Results presented are m«an percent of time estimated by 
respondents. 
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Table 17 

Perceptions of Time Utilization* 
Georgia Supervisors 
Experimental-Control Posttest Comparison 



Sub scale 


Experimental 
(n=4) 


Control 
(n=3) 


t 


P, 


Duties 


4.4 


13.3 


5.6756 


.003 


Admin istfative 
Duties 


11. 3 


13. 3 


. 2768 


.79 


Staff Development 
Duties 


6 . 9 


D 11 






Public Relations 
Duties 


11.3 


9.3 


-.7338 


. 4 9 


Case Management/ 
Quality Assurance 


41.3 


40.0 


-.0 815 


.94 


Consultative 
Duties 


13.8 


8.3 


-1. 3628 




Miscellaneous 


10.0 


8.3 







*Results presented are mean percent of tdjtie estimated by 
respondents. 
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hypothesis was tested through analysis of surveys mailed 
to supervisors in two Georgia districts at pretest (June, 
1980) and posttest (June, 1982). Results found in Table 
18 represent a 100% return at pretest and an 83% return at 
posttest. The hypothesis was not supported; there were no 
significant pretest-posttest differences on any of the sut- 
scales. 

The hypothesis was tested in Michigan among experimental 
and control supervisor^, through an analysis of variance of 
pretest results (October, 1981) and posttest results (October, 
1982) collected by Michigan agency staff development personnel. 
Pretest responses were received from 88.9% of experimental 
supervisors and 70% of control supervisors; posttest responses 
were received from 77.8% of experimental supervisors and 
70% of control supervisors. The hypothesis was not supported. 
Table 19 presents results including the AtlOVA F-test for 
interaction of time and research group on each subscale. 
There are no statistically significant differences among 
means on any of the subscales, 

The hypothesis was tested in Maryland at postttPjl;: (October, 
1982) through analyzing questionnaires mailed to each super- 
visor in the experimental and control districts. Resyo;' «.--^s 
were returned by 100% of those surveyed. Table 20 pv^sents^ 
results of t-tests (formula adjusted for equal or unequal 
variances) calculated for each sub&cale. The hypothesis 
is partially supporte'd in that experimental supervisors rcnort 
spending significantly less time than control supervisors 
in case manaqement duties although there is not a significant 
difference in time reported to be spent in consultative 
activities , 



Hypothesis 



The experimental/control comp^..:ison will show that 
experimental district secretaries spend signif icanLly 
more time in direct client assistance activities and 
less time in clerical /paperwork activities. 
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Table 18 



Perceptions of Time Utilization 
Supervisors in Two Georgia Districts 
One-way ANOVAd 



ERIC 



Subscale 



Fiscal Duties 



Administrative Duties 



Staff Development Duties 



Public Relations Duties 



Case Management 



Consultative Duties 



Miscellaneous 



*0 - Pretest 

n - 6 

2 " Posttest 

n = ? 



Time* 



0 
2 



0 
2 



0 
2 



0 
2 



0 
2 



0 
2 



0 
2 



90 



Mean (% of Time) 



9.7 
7.2 

F = .51 
p = .50 



11.5 
18.0 

F = 1.18 
P - >31 



15.2 
9.2 
F = 1.34 

^....ill.. 
11.0 

5.2 

F ^= 2.01 

30. 5 

39.0 
F = .85 
p = .38 



11.0 
10.8 

F - ,00 

9.5 
10.6 
F = .05 
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Table 19 



Perceptions of Time Utilization* 
Michigan First Line Supervisors 
Two-Way ANOVAs (Interaction Results) 



Subscale 



Experimental 
(n=8) 



Budget 
Management 



11.3 



Administrative 
Duties 



Case 
Management 



Consultation 
Duties 



18.8 



Staff Development 10.3 
Duties 



Public Relations 17.8 
Duties 



21. 9 



20.1 



Control 
(n:=:7) 



Experimental 
(n=7) 



12.1 



7.6 



F=.13 
p=.72 



25.0 13.9 
F=.13 
p=.72 



7.1 



10.7 



F=1.35 
p= .25 



Control 
(n=7) 



6.9 



17.1 



13.'^; 



13.6 



15. 7 



F=.04 

p=o 85 



24.3 



27.9 



F=.ll 

p=.75 



18. 6 



24.3 



F--:1.0 3 
p= . 3 2 



1 2 . i 



1 4 . J 



16.4 



♦Results presented are mean percent of time estimated by 
respondents. 
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Table 20 



Perceptions of Time Utilization 
Maryland First-Line Supervisors 



Mean (% of Time) 
Experimental Control 
Subscale (n=8) (n^^?) 



Budget 5.9 8.1 -.9656 .36 

Management 



Administrative 22.9 16,9 .8652 .41 

Duties 



Staff Development 15.6 13.1 .5908 .57 

Duties 



public Relations 13.1 12.9 .1096 .92 

Duties 



Case 18.8 30.0 -2.8860 .02 

Management 



Consultation 23..8 19. 0 1. 1490 .28 

Duties 
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A survey questionnaire was used to test this hypothesis. 
The instrument used in Georgia is found in Appendix 0 and 
the instrument used in Michigan and Maryland is located in 
Appendix I. 

The hypothesis was first tested during the Georgia experi- 
mental/control posttest in June, 1980. The response rate 
was 100% from both experimental and control districts. As 
shown in Table 21, a significant difference was found only 
in one of the areas of secretarial responsibility. Experi- 
mental district secretaries reported spending nearly double 
the amount of time control district secretaries reported in 
secretarial /aide duties. This is consistent with the hypo- 
thesis although reduction of experimental secretary duties 
was spread evenly among the other areas rather than being 
concentrated in clerical /paperwork activities. 

During Georgia statewide system implementation, the 
hypothesis was tested through analysis of surveys mailed 
to secretaries in two Georgia districts at pretest (June, 
1980) and posttest (June, 1982). Table 22 presents ana.lysia 
of results which are based on a 100% pretest response and 
a 92% posttest response. The hypothesis was not supports'^. 
The only significant finding was that secretaries spent less 
time at posttest in miscellaneous duties. 

The hypothesis was tested among experimental and control 
secretaries through an analysis of variance of pretest results 
(October, 1981) and posttest results (October, 1982) collected 
by Michigan agency staff development personnel. Pretest 
responses were received from 86.7% of experimental secretaries 
and 82,7% of control secretaries; posttest responses were 
received from 28% of experimbnt:al secretaries and 84,6% of 
the control secretaries. Results of hypothesis testing are 
found in Table 23 which represents the F-test for interaction 
of time and research group; the hypothesis is not supported. 

Bess cr- w» 
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Table 21 

Perceptions of Time Utilization* 
Georgia Secretaries 
Experimental-Control Posttest Comparison 



EKperimental Control t p 

Subscale (n-21) (n^ig) 

Financial/Statistical 24.0 26.6 .8673 .39 

Reportinq ., 



Dictation/ 

Transcription 



Receptionist 



Miscellaneous 



Secretarial / 
Aide Duties 



25.3 34.1 1.9643 ,14 



12.4 12.6 .0968 .92 



11.9 12.5 .2894 .77 



26.4 13.7 -2.1036 .05 



*ResuIta presented are mean percent of time estimated 
respondents . 
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Table 22 

Perceptions of Time Utilisation 
Secretaries in Two Georgia Districts 
One-Way ANOVAs 



Subscale 

Mean 


Pretest 
(% of time) 
n = 43 


Posttest 
Mean (« or time) 
n = 36 


F 


P 


Financial/ 

Statistical 

Reporting 


25.0 


28.4 


1.84 


.18 


Dictation/ 
Transcription 


33.1 


32.5 


.04 


.85 


Receptionist 


13.9 


14.1 


.00 


.95 


Miscellaneous 


12,5 


9.6 


4.16 


.05 


Secretarial/ 


15.8 


15.4 


,03 


.87 



Aide Duties 
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Table 23 



Perceptions of Time Utilization* 
Michigan Secretaries 
Two-Way ANOVAs (Interaction Results) 



Subscale 



Pretest 
Experimental Control 
(n='26) (n°24) 



Fiscal/Statistical 18.0 
Reporting 



Dictation/ 51.5 
Transcription 



Receptionist 11.5 
Duties 



Aide Duties 



7.8 



Miscellaneous 



10.9 



Posttest 
Experimental Control 
(n=7) (n«22) 



16.5 15.0 
F=.ll 
p=.74 



50.4 



55.1 



F=.07 
p=,80 



15.1 1-3.7 
F-.38 
p=.55 



7.0 6.4 
F^.OO 
p=:1.00 



11.0 e. 

F==, 46 



16.7 



50.7 



16.8 



V.-' r ^ 



■1 .• I ', 



*Results presented are mean percent of time estiu'iaLt^d by 
respondents. 
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Data was collected at posttest (October, 1982) from 
Maryland experimental and control secretaries to test this^' 
hypothesis. Results presented in Table 24 represent responses 
from 80.6% of expfrimental secretaries and 100% of control 
secretaries. Survey subscales were analyzed through t-tests 
(Formula adjusted for equal or uneaual variances) ; the hypothe- 
sis was not supported. Findings, contrary to the hypothesis 
Indicate that experimental secretaries spend significantly 
more time in clerical /paperwork activities (dictation/trans- 
cription subscale) than control secretaries. 

Hypothe sis,. 

Counselor description of supervisor behavior will 
become significantly more positive. 

This hypothesis was tested through utilization of the 
Leader Bohnvlor Description Questionnaire (LBDQ) -Form XII 
(Stoqdill, ]963). Appendix J contains a description of each 
of the twel. ;e T.BDQ subscales and a copy of the LBDQ itself. 

Tho T.BDQ was administered on fhe first day of system 
traininq sessions (Spring, 1980) for two Georgia districts 
and was mailed to counselors in thesn same two districts 
at posttest (June, 1982). Response rate was 100% at prer.est 
and 80% at posttest. Results of statistical testing of: e.^.h 
subscale are presented in Table 25. The only significant 
chanqe from ore test was that at posttest counsellors described 
supervisors as better able to tolerate uncertainty and post- 
ponement without anxiety or upset. 

The hypothesis was tested in Maryland through a compari- 
son of expei-imental counselor responses at pretest and post- 
test. At pretest, 87.8% of counselors returned the instrument 
which they were asked to complete on the first day of system 
trainlnrt in March, 1 982. There was an 87.8% response of 
t:he rK'Bttest qn, ..r,t ionnaire mailed to counselors in October, 
198?.. As Tab](: 2b demonstrates, there were no statistically 
sign i i irMrH ' i nd i \'.'V'- ■ 
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Table 24 



Perceptions of Time Utilization* 
Maryland Secretaries 



Subscale 

pi seal/ 
Statistical 
Reporting 



Mean (% of Time) 
Experimental Control 
(n=25) (n=25) 



Dictation/ 
Transcription 



Receptionist 
Duties 



Aide 
Duties 



Miscelirineous 



13.6 



37.4 



22.1 



14.6 



11. 9 



12.9 



26.1 



28.2 



16.5 



15.9 



.2630 



2.9804 



-1.6044 



-.7560 



-1.1314 



.80 



.005 



.12 



.46 



. 21 



♦Results presented are mean percent of time estimated by 
respondents. 
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Table 25 

Leadership Behavior Description Questionnaire 
Counselors in Two Georgia Districts 
One -Way ANOVAs 

Pretest Posttest 
Raw Score Mean Raw Score Mean 
Subscale (n=94) (n-72) JL 



Representation 

Demand 

Reconciliation 

Tolerance of 
Uncertainty 

Persuasiveness 

Initiation of 
Structure 

Tolerance of 
Freedom 

Role 

Assumption 

Consideration 

Production 
Emphasis 

Predictive 
Accuracy 

Intearation 

Superior 

Orientation 



19.2 
18.0 

33.6 

36.6 
38.7 

36.5 

38. 3 

36. 9 
33.4 

17.4 

17. 2 
34.7 



18.4 
18.5 

36.6 

36.0 
38.7 

37.6 

38.2 

37.6 
34. 8 

17. 5 

17. 5 
36. 2 



2.9b 
. 6 3 

8.54 

.36 
.00 

.79 

.00 

.40 
2.90 

.on 

. 26 

3. 20 



.09 
.43 

.004 

.55 
1.00 

.38 

.97 

. 53 

.09 

. Oh 

. 62 
. OB 
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Table 26 

Leadership Behavior Description Questionnaire 
Maryland Experimental Counselors 
One-Way ANOVAs 



Subscale 



Pretest Posttest 
Raw Score Mean Raw Score Mean 

(n=36) in=>36) t 



p 



Representation 17.6 

Demand 16.2 
Reconciliation 

Tolerance of 30.9 
Uncertainty 

Persuasiveness 31.2 

Initiation of 35.5 
Structure 



34.4 
34.1 

Consideration 33,1 



Tolerance of 
Freedom 

Role 

Assumption 



Production 30.8 
Emphasis 

Predictive 15.9 
Accuracy 

Integration 15.5 

Superior 33.8 
Orientation 



18.3 
16.9 

32.0 

31.3 
36.4 

36.6 

35.6 

33.4 
31.1 

16. 2 

15.7 

33.9 



-1.0180 

- .7161 

- .5647 

- .0865 

- .7602 

-1.0559 
-1,1598 

- .1813 

- .26 27 

- ,3815 

- .1987 

- .1017 



.32 
.48 

.58 

.94 

. /ib 

, 30 

. 25 

. 71 

. 85 

„ 92 
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Hypothesis 



Work alienation scores will show a significant 
decrease. 

Testing this hypothesis was accomplished through utiliza- 
tion of the "Indices of Alienation," a survey instrument 
developed by Aiken and Hage (1966) to measure six facets of 
organizational or work alienation. These six facets are 
measured through six subscales described and presented with 
the questionnaire in Appendix K. On a scale of 1-5, higher 
scores reflect higher alienation and lower scores represent 
lower alienation. 

The alienation scale was mailed to 25% of the Georgia 
agency professional staff. The sample encompassed counselors, 
first-line supervisors, and "others" which includes middle 
and upper management, evaluators, job placement specialists, 
and facility employees. At pretest responses were received 
from 85% of those who were surveyed, including an 87% response 
rate among counselors and an 88% response rate among first- 
line supervisors. The 1981 posttest resulted in a 71% overall 
response rate including a 79% counselor response and a 100% 
first-line supervisor response. The final posttest (1982) 
included an overall 63% response rate including a 67% counselor 
response rate and a 75% first- line supervisor response rate. 
A one-way ANOVA was conducted for each subscale for the total 
sample, for counselors only, and for first-line supervisors 
only. As indicated by Table 27, testing this hypothesis 
in the Georgia agency resulted in no significant findings. 

Staff development personnel with the Michigan agency 
administered the questionnaire among experimental and control 
personnel at pretest (October, 1981) and at posttest (October, 
1982) . A two-way analysis of variance was performed on each 
survey subscale sample,, for counselors only, for first-line 
supervisors only, and for secretaries only. Pretest responses 
were received from 100% of experimental staff and 97% of 
control staff including a 100% counselor response, an 80% 
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Table 27 

* Indices of Alienation 
Georgia Statewide Sample 
One-Way ANOVAs 



ERIC 



Subscale 


Time** 


Jobs 


Counselors 


Supervisors _ 


Alienation 


u 


X= 


1 . 8 




iS . U 


X— 


1 . / 


from Work 


1 




2.0 


x= 


2. 2 


x= 


1 . 9 




2 


x= 


1.9 


x= 


2.1 


x= 


>2.2 






F:= 


1.72 


F= 


1.62 


F= 


•l • 








.18 


P= 


. 20 


P= 


= .33 


Alienation 


u 


X = 


•1.6 


x= 


J. . 6 


X= 


■1 . z 


from 


1 


x= 


=1. 8 


x= 


.1 o 
•1 . 0 


x~ 


•1 . D 


Expressive 




x= 


=1.7 


x= 


a. 7 


x= 


=1.6' 


Relations 




F= 


=1 . 95 


F= 


=1 « 6H 


■ri — 

r 


-1 . X .1 






p= 

ir 


= .15 


P^ 


= .19 


p:. 


= .36 


Index of 


0 




=1 . 7 


x= 


= i . 7 




-1 7 


Hierarchy 


1 


x= 


=1.8 


x= 


= 1 . 8 


X - 




of Authority 


2 


X- 


=1.7 


X- 


=1.7 


X - 


--1 „ 7 




F = 


= . 48 




= .55 




. U 0 








= .63 




50 


P^' 




Index of 




... 

X = 


=4 . 0 


x= 


= 4 • 3 


... 

X' 


-••3 •] 


Participation 


1 


x= 


-4.1 


X=: 


= 4. 5 


X- 


' 1 CI 


in Decision - 


2 


x= 


-3.9 


x= 


= 4.6 




^•3.2 


Making 




J? 




1 


= ?fi 
■ <^ \/ 


F- 


36 






-.73 




= . 78 




• , 71 


Index of 


0 




-2.7 


X- 


-•^.2.7 


X 


--'•2.7 


Job 


1 




=2. 9 


x= 


= 2. 8 


X- 


-2.7 


Codification 


2 


x= 


-2.7 


x= 


= 2.7 


X 


^2.8 






F= 


=2.47 




= .64 


F 


•=.16 






P^ 


= .09 


P- 


= 53 


p 


= .85 


Index of 


0 


X 


-1.. 9 


X 


-1.9 


X 


-1.9 


Rule 


1 


X 


= 2.1 


X 


-2.3 


X 


=1.6 


Observation 


2 


X 


-2.1 


X 


-2.4 


X 


= 2,2 






F 


-2ol3 


F 


= 2. 59 


F 


= .99 






P 


= .13 


P 


= .08 


P 


= .39 



**Time 0=Pretest; Time 1=1981 Posttest; Time 2=1982 Posttest. 

1981 1982 



All Jobs 

Counselors 

Supervisors 



Pretest 
109 
62 
7 



Posttest 
91 
56 
8 

102 



Posttest 
80 
47 
6 



BEST cr: ' 



87 



first-line supervisor response, and a 100% secretary response. 
Posttest responses were received from 6 8% of the experimental 
staff (86% counselors, 100% supervisors, 28% secretaries) 
and from 92% of the control staff (89% counselors, 80% super- 
visors, 100% secretaries). Tables 28-31 present the ANOVA 
F-tests for interaction of time and research for each subscale 
for the total sample (Table 28) , counselors only (Table 29) , 
first-line supervirors (Table 30) , and secretaries (Table 
31) . Table 28 indicates significant change of the third 
and fifth subscales in support of the hypothesis. At posttest, 
experimental staff report that they feel greater freedom 
to comp:.ete tasks with less supervisory interruption and 
that they feel less confined by rules regarding their v;ork. 
These findings are true for the counselors as a group (Tfi-bie 
29) but not for supervisors (Table 30) or secretaries (Table 
31) . There were no significant findings for the supervisory 
group.* Among secretaries, the change on the third subscale 
(freedom to complete tasks) was not statistically significant, 
although experimental secretaries do report feeling less 
confined by rules at posttest than at pretest. 

This hypothesis was tested through analyzing responnies 
to surveys distributed to experimental counselors and firsi;- 
line supervisors in the Maryland agency. Responses were 
received from 94% at pretest (88% counselors, 100% supervisors) 
and 96% at posttest (90% counselors, 100% supervisors). Table 
32 presents results of one-way ANOVAs conducted for the total 
group, for counselors only, and for supervisors only. Results 
for the total experimental group and for counselors only 
indicate statistically significant findings on four of six 
subscales: these two groups report less disappointment with 
career, more freedom to implement tasks without supervisory 

*it should be noted that there are some rather large experi- 
mental changes demonstrated on Table 30, however, the small 
sample size limits the sensitivity of the ANOVA. 
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Table 28 

Indices of Alienation 
Michigan Sample: All Jobs 
TwoWayANOVAs (Interaction Results) 



Subscale 



Pretest 
Experimental Control 
(n=-81) (n=77) 



Alienation from 
Work 



2.1 



Alienation from 1.8 
Expressive 
Relations 



Index of 2.6 
Hierarchy of 
Authority 

Index of " 4.3 

Participation in 
Decision - 

Making 

Index of 3.2 
vJob 

Codification 



Posttest 

Experimental (.'oMtx 
(n-48) in-'" 



2.1 



2.1 



F=^.15 
p=.71 



1.8 



2.2 



4.3 



3.0 



] . 8 



F-.06 
p=.81 



F=B. 78 
p=.004 



P=. 00 
P-.97 



F=ll. 35 
P-.0009 



1.8 



2.7 



2. J 



2 . I 



4. . 



Index of 2 . 6 

Rule 

Observation 



2. 



F-. 13 
p^. 73 



2.3 



ERIC 
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Table 29 

Indices of Alienation 
Michigan Sample: Counselors 
Two-Way ANOVAs (Interaction Results) 



Sub scale 



Pretest 
Experimental 
(n-41) 



Alienation 
from Work 



2.3 



Posttest 

Control Experimental Control 
(n=40) (n=32) (n=25) 



2.3 



F=l . 55 
p= . 22 



2.1 



2.4 



Alienation from 
Express ive 
Relations 



1.7 



1.9 



F= 
p= 



.04 
. 85 



1.7 



1.9 



Index of 

Hierarchy of 
Authority 



2,5 



Index of 4.6 
Participation in 
Decision-makinq 



2.1 1.7 
F=5.44 
p= .03 



4.5 4.6 

F= .04 
P=-" .85 



2.1 



4.6 



Index of 
Job 

Codification 



3.1 



2.9 



F-5. 31 
p--= .03 



2.6 



2.9 



Index of 
Rule 

Observation 



2.7 



2.3 



F-^ .07 
P= .79 



2.5 



2.2 



105 



90 



Table 30 



Indices of Alienation 
Michigan Sample: First-Line Supervisors 
Two-way ANOVAs (Interaction Results) 



Pretest 
Experimental Control 



Posttest 
Experimental Control 



tiUDScaie 

Alienation from 
Work 


2.0 


1.9 


P=.09 
p=.77 


2.1 


1.9 


Alienation from 
Expressive 
Relations 


1.7 


1.9 


P=.82 
P=.38 


2.2 


1.9 



Index of 
Hierarchy of 
Authority 



Index of 
Participation 
in Decision- 
Makinq 



Index of 
Job 

Codification 



Index of 
Rule 

Observation 



2.1 



2.6 



2.9 



2.8 



1.9 



1.5 



P=.35 
p=. 56 



2.2 



2. 5 



F=.0 2 
P-.89 



2. 8 



2.8 



F=.01 
p=.92 



2.3 



1.7 



F=1.10 
p= .31 



1.7 



2.0 



2.8 



1.9 
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Table 31 



Indices of Alienation 
Michigan Sample: Secretaries 
Two"^ay ANOVAs (Interaction Results) 



Subscale 



Pretest 
Experimental Control 
(n=30) (n==29) 



Alienation From 
Work 



Alienation from 
Expressive 
Relations 



Index of 
Hierarchy of 
Authority 



Index of 
Participation 
in Decision 
Making 



Index of 
Job 

Codification 



Index of 
Rule 

Observation 



2.0 



1.8 



2.7 



4.5 



3. 2 



2.4 



Posttest 
Experimental Control 
{n=7) . (n= 26) 



2.0 



F==.02 
p-:88 



2.4 



F=.16 
p=.70 



4,5 



F=,00 
p=.95 



3,2 



F-=5.51 
p= .03 



2.0 



1.8 2.1 

F'=. 84 
P-.37 



2.4 



2/1 



2.1 2.1 

F=. 04 
P-.85 



2.1 



1.7 



2.3 



4.5 



1.9 



ERIC 



107 



9-2 



Table 32 

Indices of Alienation* 
Maryland Experimental Sample 
One-way AKOVAs 



Subscale 



Time** 



All 
Jobs 



Coun selors 



Alienation 
from 
Work 



0 
1 



x=2.4 
x=2.1 
F=4.43 
p=.04 



x=2. 6 
x=2. 2 
F=5.77 
p=.02 



Alienation 
from 

Expressive 
Relations 



0 
1 



x=1.9 
x=1.8 
F=.71 
p=.41 



x=2.0 
x=1.8 
F=.98 
P-.33 



All Jobs 
Counselors 
First-Line 
Supervisors 



Pretest 
46 
36 

8 



Posttest 
47 
37 

8 



First Line 
Supervisors 



x=:2.1 
x==2.1 
F=.01 
P-.94 



X=:1.6 

x=1.6 
F=.00 
p=1.00 



Index of 
Hierarchy 
of Authority 


0 
1 


x=2.4 
x=1.7 
F=13.98 

p=, 0003 


x=2.5 
x=1.8 
F=13. 25 
p=.0005 


x-1 .6 
x=1.5 
F=^,35 

P-.57 


Index of 
Participation 
in Decision- 
Making 


0 

1 


x=4 . 2 
x=4.0 
F=.57 
P-.46 


x=4.7 
x-4. 5 
P=2. 50 
p==.12 


x=2. 8 
x=2. 7 
F-_..04 

p^. 85 


Index of 
Job 

Codification 


0 

1 


x=2.9 
x=2. 6 
F=6.74 
p=. 02 


x=3.0 
x=--2.5 
F=7.76 
p=v007 


x-2.. 8 
7 

F=.08 
p=.78 


Index of 
Rule 

Observation 


0 

1 


x=2. 6 
x-2.0 
F=8.48 
p=.00 5 


x=2. 6 
x = 2.1 
F=3. 97 
p=.0 5 


x^2.7 

K = 1.6 

F=6.69 

P-.03 



**Time 0=1981 Pretest; 1=1982 Posttest 
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interruption, more control over their work, and that rules 
are enforced to a lesser degree than at pretest. Among super- 
visors, the only statistically significant finding waB that 
they report a lesser degree of rule enforcement at posttest. 

Hypothesis 

Job satisfaction scores will show a significant increase. 
This hypothesis was tested through utilisation of the 
"Job Descriptive Index" (Smith, Kendall, and Hulin, 1969). 
Appendix L contains a copy of this instrument. Each page of 
the survey is scored as a subscale with a possible scoring 
range of 0-54. High scores represent high job satisfaction. 

Testing the hypothesis in Georgia was accomplished with 
results of surveys mailed with the alienation scale. Pretest 
responses were received from 85% of the total sample, 87* oi 
counselors, and 88% of first-line supervisors. 19B1 postcest 
responses were received from 66% of the total sample, 7 3% 
of counselors, and 88% of first- line supervisors. 198. po.^t- 
test responses were received from 59% of the total .a-npi.. 
65% of counselors, and 75% of first-line .supervisors, -.-i.,.. 
33 presents results of analysis of the surveys, there were, 
no statistically significant results. 

surveys were distributed with alienation sun-m-s by 
Michigan staff development personnel. Af pretest, ircsuM:. 
were received from 99% of th. experimental staff (100% coun- 
selors, 97% secretaries, and 100% supervisors) .Md 9/% of the 
control staff (100% counselors, 80% supervisors, 100% ."c, - 
taries). At posttest, results were received from 60% of the 
experimental staff (86% counselors, 89% supervisors, 28^, .==ec.. 
retaries), and 91% of the control staff (86% coun-.elors , 80% 
supervisors, and 100% secretaries). None of the I.-^est. .or 
interaction of time and research group resulted in statistically 
signiricant findings (see Tables 34-37). 

This hypothesis was tested through analyzing responses 
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Table 33* 



Job Descriptive Index 
Georgia Statewide Sample 
(One-way ANOVAs Results) 



All First Line 

Subscale Time** Jobs Counselors Supervisors 



People on 0 B=41. 7 x=42. 5 X--47.3 

Present Job 1 x=40.3 x=40.n x=41.9 

2 x=41.8 x=41.8 x-45.3 

F=.46 F=.70 F=.64 

p=.64 P--.50 p-,54 



Work on 0 x=37.9 x=37.5 x=35.9 

Present Job 1 x=34.8 x=34.3 x=32,5 

2 x=35.3 x=34.0 x=29.5 

F=2.96 F=2.f>6 F = .69 

p=.06 p=.06 p=.52 



Present Pay 0 x=18.8 x=17.7 x-22.0 

1 x=19.9 x=19.0 x=19.7 

2 x=21.6 x=19.4 x=19..3 
F=1.22 F=.29 F=^.12 
p=.30 p^.-'S p=.90 



Opportunities 0 x=11.9 x=9.5 X--12.6 

for Promotion 1 x=11.6 x=8.8 x^l.4.3 

2 x=10.8 x=9.0 x= 7.3 

F=.19 F=.06 F=1.0 

p=.83 p=.94 P-.39 



Supervision on 0 x=42.7 x=42.2 x=48.0 

Present Job 1 x=40.8 x=39.2 X-4B.1 

2 x=43.1 x=41.5 x=44.7 

F=.73 F=.85 F=.22 

p=.49 p=.43 p=.81 



**Time 0=Pretest; 1=1981 Posttest; 2=1982 Posttest 



*N= 



All Jobs 
Counselor 
First-Line 
Supervisors 



Pretest 
109 
62 



1981 
Posttest 
85 
52 



1982 
Posttest 
76 
46 
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Table 34 



Job Descriptive Index 
Michigan Sample: All Jobs 
Two-way ANOVAs (Interaction Results) 



Sub scale 



People on 
Present Job 



Work on 
Present Job 



Present 
Pay 



Opportun itios 
for Promnl-.ion 



Supervision on 
Present Job 



Pretest 
Experimental Control 
(n=80) (n^77) 



41.5 



31.5 



30.4 



10.8 



41.5 



Posttest 
Experimental Control 
(n==48) (n=--58) 



3 0.8 42.3 
P-1.12 
p- .29 



32.4 30.1 

F- .09 
p- .77 



29.:! 30.2 

p:-:i .00 ' 

.32 



10.6 



8.4 



b9 



■ .45 



40.7 38.7 
.67 

p^ .42 



37.6 



30.0 



26 . 1 



10.3 



40. 2 
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Table 35 



Job Descriptive Index 
Michigan Sample: Counselors 
Two-way ANOVAs (Interaction Results) 



Subscale 



People on 
Present Jot 



Work on 
Present Job 



Present 
Pay 



Opportunities 
for Promotion 



Supervision on 
Present Job 



Pretest 
Experimental Control 
(n=41) (n=40) 



41.6 



30. 2 



29.6 



8.6 



40.0 



Posttest 
Experimental Control 
(n==32) (n^24) 



37.6 



29.2 



10.0 



F=. 20 
p=:. 66 



F=.07 
p=. 80 



F=.33 
P-. 57 



42.0 



33.0 29.5 
F=.82 
p=.37 



29.5 



6.9 



39.5 37.7 
F=.03 
p=.87 



36. 3 



29.1 



27. 9 



10.3 



J8. 1) 
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Table 36 



Job Descriptive Index 
Michigan Sample: First-Line Supervisors 
Two-way ANOVAs (Interaction Results) 



Pretest Posttest 
Experimental Control Experimental Control 
Subscale (n^'S) (n=8) (n==8) (nf.8) 

People on 45.0 42.8 46,4 45.4 

Present Job F~.06 

p=:.81 



Work on 
Present Job 


34.6 


35.6 


F=.12 
p=.74 


34.7 


37.8 


Present 
Pay 


30.7 


31.0 


P=. 59 
p:=.45 


30. 9 


25.3 


Opportunities 
for Promotion 


16.1 


22. 5 


F=.02 
p=. 90 


10.0 


17.5 


Supervision on 
Present Job 


36.0 


42.1 


F=.10 
p=.76 


38.7 


43o6 
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Table 37 



Jo'") Descriptive Index 
Michigan Sample: Secretaries 
Two-way ANOVAs (Interaction Results) 



Pretest 
Experimental Control 



Posttest 
Experimental Control 



People on 
Present Job 


41.5 


42.0 


P=.24 
p=.63 


38.7 


36.4 


Work on 
Present Job 


30.4 


30.6 


P«.08 
pa. 78 


26.6 


28.5 


Present 
Pay 


31.6 


29.1 


P-.72 
p«.40 


32.3 


24.8 


Opportunities 
for Promotion 


9.7 


8.2 


Pa. 60 

p«.44 


12.9 


8.2 


Supervision on 
Present Job 


44.7 


41.5 


P«.08 

pa. 78 


43.0 


41.3 
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Table 38 

JoL Descriptive Index* 
Marylai.d Experimental Sample 
One-way ANOVAs 



All First-Line 
Subscale Time** Jobs Counselors Supervisor s 



Peoole on 
Present Job 


0 
1 


x=37. 9 
x=38. 4 
F=,03 
p=. 88 




x«36. 1 
x=36 . 5 
F=.02 
p=. 90 


x«44.3 
x=43.6 
F=.01 
p=.92 


Work on 
Present Job 


0 

1 


x=28. 5 

x=31. 2 
F«1.54 
p= .22 




x==27.4 

x=29. 9 
F=1.09 
p= .30 


x=-31.4 
x=33 . 1 
F = .13 
p=.72 


Present Pay 


0 

1 


x= 8. 5 

x-12. 7 
F=3.06 
p== .09 




x= 7.9 

x^=12. 2 
F=--2.39 
p= .13 


9.3 

x=10 . 8 
F = , 11 
p=.75 


Opportunities 
"FoT PTHinot'ion 


0 
1 


x= 8. 2 

x=13.0 
F=2. 34 
p= .13 




x= 5,5 

x=12.3 
F=4.58 
p= .04 


x=14,8 
x= 9.8 

F ".3 


Supervison on 
Present Job 


0 

1 


x=34. 2 

x=41.6 
F=5. 34 
p== .03 




x=33.8 
x=40. 1 

F==2« 97 
p= .09 


X---4 5. 5 
P- .14 


* N « 

All Jobs 
Counselors 




Pretest Posttest 

45 47 
36 37 





First-Line q q 

Supervisors 

**0 = 1981 Pretest; 1 = 1982 Posttest 
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to surveys distributed to experimental counselors and first-- 
line supervisors in the Maryland agency. Responses were 
received from 92% (88% counselors and 100% supervisors) at 
pretest and 96% (90% counselors and 100% supervisors) at 
posttest. Table 38 presents results of one-way ANOVAs computed 
for each group on each subscale. The only statistically 
significant findings were on the fourth and fifth subscales. 
Analysis of the fourth subscale indicates that counselors 
report being more satisfied with opportunities for promotion 
at posttest than at pretest. On the fifth subscale, counselors 
and supervisors as a group report being more satisfied with 
supervision at posttest than at pretest. 

Project Forum 

Seventy people representing the three pilot states, the 
Rehabilitation Services Administration, the National Institute 
of Handicapped Research, and the University of Georgia attended 
the Management Control Project Forum held November 3-5, 1982 
in Atlanta, Georgia. The opening session addressed the purposes 
of the forum, expected outcome, and relationship of the outcome 
to future project activities. An overview of pertinent factors 
which led to the decision of the Georgia, Michigan, and Maryland 
rehabilitation programs to participate as project pilot states 
was given. Four objectives were established by the forum 
planning committee and disseminated to participants prior 
to the forum. Additionally, the issues to be explored as 
a means to meet the forum objectives were disseminated and 
validated prior to the opening session. Identified below 
are the forum objectives and related outcome of the forum 
experience. 

Objective #1 ; To disseminate information and research 
findings regarding the Management Control Project. 

Forum participants- received an overview of major research 

findings based on external reviews, survey responses, 
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individual feedback, and anecdotal data. These findings 
are presented within this final report. 

Objective #2 ; To continue investigation and evaluation of 
the management control system as an alternative to 
traditional management systems. 

The planning committee identified relevant issues for 
group investigation, surveyed respective staffs to validate 
these issues, and developed pre-forum activities designed 
to facilitate the forum sessions. Group facilitators and 
recorders were provided an orientation to their roles in 
relation to discussion issues. A small group design was 
utilized to assure productive interaction on all levels of 
the organizations represented. Results of group exploration 
regarding the identified issues are found in Appendix M. 

Objective #3: To share experiences of project participants 

as a means of contributing to future project utilization 
efforts . 

The forum was designed to capitalize on the potential 
contributions of participants. Of the three days of program- 
ming only two hours were devoted to other than exploration 
activities by the group. Facilitators we;re selected based 
on demonstrated group facilitation skills and received an 
orientation prior to the forum. 

Objective #4; To form a coalition of participating MCP states 
' to provide mutual support and continued dissemination 
of project information. 

Discussion groups rotated frequently and were composed 
of a mix of representatives from each state. Additionally, 
evening activities were designed to further stimulate a 
comraderie among participants. 
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E. Conclusions and Recommendations 

The goal of the Management Control Project i3 to demon- 
strate optimal rehabilitation agency performance through 
the application of a management system which eliminates 
unnecessary and spurious controls and utilizes perfom^ance 
standards maintained by skilled managers. Although project 
staff do not suggest that optimal agency performance has 
been attained, the value of a systems approach to the manage- 
ment of rehabilitation service delivery has been effectively 
demonstrated and is clearly documented through the project's 
research findings. Based on external performance review 
results and the. analysis of survey data, operationalizing 
the management control system in three state rehabiliLahion 
agencies has resulted in: 

1. A significantly increased percentage of accurate 
eligibility decisions. Services are provided to 
a greater number of genuinely el igible peop].e and 
are denied only to genuinely ineligible people. 

a. Significantly improved evaluation of disabling 
and handicapping conditions and thus an improved 
understanding of client rehabilitation need^* 

b. Significantly improved assessment of client 
rehabilitation potential. 

c. Better client understanding of the rehabilitation 
process and a reduction in client appeals^ 

2. A significant improvement in the provision of services 
consistent with the client's total rehabilitation 
need. 

a. Better comprehensive planning based on client 
needs. Comprehensive client evaluation has 
allowed definition of all rehabilitation services 
necessary for clients to achieve vocational 
potential . 
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b. Increased client involvement in planning and 
in the entire rehabilitation process. 

3. A significant increase in agency fiscal accountabilty . 

a. Funds are expended on genuinely eligible clients. 

b. Increased awareness and utilization of similar 
benefits. 

4. A significant increase in counselor perception 
of freedom to accomplish assigned tasks without 
supervisory interruption. 

5. A significant increase in counselor perception of 
control over accomplishing their work* 

Performance improvement following management control system 
installation has been great. Ultimately , more clients will 
be more suitably employed^ functioning at a level consistent 
with their potential. The performance improvement has been 
observed following the reduction of controls through policy 
streamlining. It is suggested that clarifying expectations, 
communicating clear and concise policy, and providing timely 
reinforcement has facilitated appropriate client planning 
and casework documentation. The system thus results in 
the opportunity for counselors to function as prof es^sionals 
when they are able to demonstrate rehabilitation sKills. 

Interview data collected in the Michigan and Maryland 
agencies indicates that an improved counselor/supervisor 
relationship results when a supervisor makes the effort 
to adapt to the new system. It is suggested that this is 
the result of increased development and utilization of manager 
skills in the areas of performance management and team 
development. 

Many positive results of system installation have been 
reported by participants in the pilot states. The reader 
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is referred to Appendix M for a review of forum discussion 
qroup reports on specific project issues. 

The project research and demonstration experience has 
generated expertise and materials having implications for 
the rehabilitation community: 

1. A mechanism through which an agency is able to 
assess organizational environment, structure, 
operations, and performance. 

2. A format for organizational planning. 

3. A program of management skill development in the areas 
of performance management and team development. 

4. A program of counselor skill development in the 
application of performance standards. 

5. A program evaluation design to assess the effects 
of the management control system. 

Caution 

As a postscript to project conclusions, a warninq is 
expressed to the reader. On paper, installation of the 
management control system appears to be much simpler than 
it has actually proved to be. Administrators consider ing 
such an approach are urged to discuss system implicationy 
with project staff and with administrators in the three 
pilot states. Additionally, atte.it ion must be givtr. to: 
1. Adopting a philosophy— Before entering into any 

systems approach, an agency must look at its philo- 
sophy in two areas. First, we must clearly develop 
and internalize an organizational philosophy which 
communicates beliefs related to the organization and 
its delivery of services to handicapped people. 
Second, we must also develop and internalize a manage- 
ment philosophy which communicates our beliefs as to 
how we will manage ourselves as a system. 

A philosophy for an organization only has merit if 
it is understood, internalized, and practiced by the 
decision makers. Once a philosophy is adopted, 
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decisions made in the organization must consistently 
reflect that philosophy. Too often a;* impresBive 
statement of philosophy is developed and future 
decisions reflect either a lack of commitment to 
the statement or a lack of understanding of the 
concepts which formulated the philosophy. Staff 
are quick to recognize inconsistencies in decisions; 
the result is reduced administrative credibility. 
Decisions inconsistent with a stated philosophy 
can make a mockery of a management system. 
Reinforcing performance standards — Agency expecta- 
tions are communicated to staff through performance 
standards. For some staff, communication of standards 
is sufficient to assure quality work productirn. 
For many^ behavior must be reinforced. Goori beho/vior 
must be rewarded to be maintained and ther(-^^ must 
be consequences for poor behavior. No system can 
be effective without the appropriate behavjc^r rein-- 
f orcement . 

Every organization can likely identify pGrsonr«oL 
who do not perform at a level desired. This mauarre- 
ment system clearly identifier p«=:r f ormance wi:GV.-"«, , 
and provides administ.rator5J wit.h c^oncrete dc^La 
to utilize in dealing with performance of personnel. 
Maintaining and reinforcing system-^Once any management 
system is in place, it must be maintained and reinforced. 
The management control system has been demonstrated 
as an extremely effective system. Inherent in 
this system has been control reduction/ p^rf onr,:^nce 
reinforcement by management, and the continued 
development of manager and counselor skills. 

Even after a positive demonstration experience 
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there appears to be a tendency for agencieo to 
return to traditional management behaviors. Controls 
slip back into policy manuals without appropriate 
rationale, manager skill development becomes a 
lower priority, and appropriate reinforcement tech- 
niques are forgotten or misdirected. Some might 
suggest the system has become less effective. Project 
staff suggest that too many agency personnel are 
more comfortable adding controls to solve problems 
than utilizing management techniques to promote 
accurate and effective performance. 

Recommendations 
The successful demonstration of a systems a):proach 
to the management of service delivery suggests that the research 
findings of the Management Control Project must be utilized. 
Additionally, a research and demonstration effort of the 
magnitude undertaken by this project leaves unanswered questions 
and unresolved issues as initial problems are solved ar.d 
research questions answered. Recommendations are: 

1. Funding of a utilization plan to install die maiiaq'.i- 
merit control Bystem in additional state rehabilj^raticii) 
agencies and to provide technical assi.stanco tj 
pilot states the system is operationalized state- 
wide* 

a* Utilize the refined process of management control 
system implementation based on project experience 
and research findings; 

Further demonstrate to thf^j rehabilita ;...on commun- 
ity the benefits of a systems approach; and 
c* Develop a cadre of rehabilitation personnel 

with expertise in the components of the manage- 
ment control system. 
Discussion: Funding a utilization effort to include 
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the installation of the management control system in 
additional state rehabilitation agencies is essential. 
Only after experience in demonstrating a systems 
approach coupled with tho unique contributions of the 
pilot states, have project staff been able to conceptua- 
lize the interrelationship of problems confronting 
state agencies and begin to formulate plans for as 
complete a solution as possible. System refinements 
resulting from the R&D experience must be demonstrated 
as effective. Successful marketing of the management 
approach supported by the research findings contained 
in this report can be best accomplished through the 
successful demonstration of the system. 

Expertise in the components of the management cfUitrol 
system is limited to project i.taff and a few individuals 
within the pilot states. For extensive utilization 
of research findings to become a reality, a broader 
base of "experts" must be developed. 
2. Assessment of the long range effects of systejm 
installation. 

a. Counselor performance; 

b. Supervisor performance; 

c. Counselor /supervisor relationship; 

d. Work attitudes; 

e. Administrative and client service costs; and 

f. Client outcome. 

Discussion: Time limitations of a R&D grant prevent 
researchers from assessing the long range effects of 
treatment. Within this R&D effort, the grani: period 
allowed for assessment of system installation aft^r 
less than one year in two of the three participat ina 
agencies. Since the three pilot state agemd.os plan 
ho ope'-ationaiizG and maintain the managemc;nt control 
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system statewide, there is an excellent opportunity 

to determine the long range effects of system installation. 

Project staff have found that counselor training 
will result in a significant performance improvement. 
Our experience and findings, however, indicate that 
this improvement does not increase over time, and prob- 
ably cannot be maintained without the optimal development 
of the organization, particularly, management performance. 
If the system is properly maintained, a continual improve- 
ment in both counselor and supervisor performance should 
be demonstrated. As supervisor reinforcement skills 
develop, counselor receptiveness to supervision should 
improve . 

Time is a factor in evaluating the coot/bc^nef icia i 
outcomes of system installation. Project planners 
hypothesized an administrative cost savings would be 
realized through increased counselor professional func- 
tioning accompanied by decreased supervisory time .spent 
with counselors. Planner: 'so projected a savingc 
in client service expendit es resulting from more 
effective diagnostic work, Detter utilization of similar 
benefits and improved IWRP development. The qzant 
period has not allowed for an adequate evaluation of 

these factors. 

Evaluation of effect on clients has not been possible 
because there has not been a sufficient number of clients 
moved through the rehabilitation process from initial 
interview to successful closure and served by counselors 
operating with perfomance standards. Tt is aciticipated 
that fewer clients will return to the agency for services 
following closure, that the average length of the rehabili- 
tation process may change, that client sucttesa rate 
wi]] increase, and that rehabi li^•-nt:ions wl l.L reflect 



BEST COW f*^*'^ 

124 



.10 9 



aqency values more consistently, 

3. Encouraqe experimentation with salary supplements 
to counselors and managers exhibiting high levels 
of performance. 
Discussion: With performance standards and a mechanism 
for objective evaluation of employee achievement in 
place, a major blockage to providing salary supplements 
has been eliminated. This concept continues to interest 
some state rehabilitation agencies and state personnel 
systems. The project, unfortunately, did not secure 
personnel system approval in time to evaluate the 
effect of salary supplements on performance. The 
current experimentation by the Georgia Division of 
Rehabilitation Services and efforts by other interested 
rehabilitation agencies should be encouraged. 
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E. Utilization Plan 

The integration of a new management system into state 
rehabilitation agencies is complex. Experience with the 
installation of performance standards in three pilot agencies 
demonstrated that these standards cannot stand alone and 
isolated from agency policy requirements, the skill level 
of managers in measuring performance, leader behavior, the 
definition of roles and functions of personnel at different 
levels in the agency, and the existence of quality assurance 
throughout the agency. Optimal development of management 
skills and behaviors is believed to be the most important 
and essential element, the area in which time must be con- 
centrated, in order to maximize agency perf orrriance. Organi- 
zational performance problems become evident at Lbo level 
of counselor performance and can be partially alleviated 
through the communication of clear expectations (standards) 
and through counselor training. It has> how-ver , become 
apparent through this research and demonstration effort 
that adequate solution of performance deficiencies requires 
intensive study and resulting development oC agency mana-je~ 
ment skills in the areas identified. 

Each state rehabilitation agency has a unique ] ei:..o-nali^: v .- 
a composite of tradition, staff personal itit.s , nnd lr:?4dersh,i p 
styles demonstrated by top administrators. Althouqn manage- 
ment literature and this report communicate a systems approach, 
a packaged model ready for implementation by interested 
agencies would not be effective. The difficulty lies in 
the ability to internalize a philosophy, analyze one'.-, own 
strengths and weaknesses, capitalize on one's own uniqueness, 
and develop the essential staff skills for effectively opera- 
tionalizing the system. To assure the utilization of the 
research and demonstration findings of this project, rehabi- 
litation agencies must recognize the benefits of the approach 
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described and a cadre of personnel must develop expertise 
in the components of the management control system- 
Rehabilitation agency recognition of a systems approach 
to the management of service delivery. 

The desire of state rehabilitation agencies to meet the 
congressional intent of rehabilitation law, to provide con- 
sistent and quality services to handicapped people across 
program lines, and to maximize the utilization of resources 
is not questioned. An approach to accomplishing these goals 
require substantial demonstration and proven effectiveness 
to merit an agency's commitment. So far, interest in the 
concepts advocated by the Management Control Project has 
developed from within rehabilitation organizations rather 
than from external encouragement or marketing strategy. The 
research design for the R&D phase of this project called for 
the demonstration of the management control system in pilot 
areas of three state rehabilitation agencies. Several pro- 
grams expressed a desire to participate in the demonstration 
effort. The Georgia, Michigan, and Maryland rehabij.i catioii 
agencies were selected as pilot states and, after denn^nstration . 
each has elected to operationalize the system statewide. 
At this writing, five additional state rehabilitation aqeric j o;-> 
have given an administrative commitment to further deriionsLrate 
the system and several others have expressed an interest in 
being considered as demonstration agencies should utilization 
funding be secured. 

Development of cadre of rehabilitation p ersonn el with ex^:^ertise 
in the components of th e manage ment control system . 

As syst'^m demonstration occurs, so does the opportunity 
to broaden the base of "experts," Within each RSA region, 
multiple resources are available to state rehabilitation 
agencies. University RCTP's, RCEP's, R&T centers, and other 
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programs have personnel who are potential experts in the 
components of the system. When combined with experts from 
demonstration state agencies, a valuable resource will exist 
for other agencies interested in system installation. 

Utilization Approach 

The design of this project suggests a unique approach 
to the utilization and dissemination of a highly successful 
and viable research and demonstration effort. It proposes 
a partnership among state rehabilitation agencies and capi- 
talizes on the expertise of personnel with experience in 
the demonstration of the management control syst-^m. 

During a utilization period, it is expected that the 
management control system could become operational in three 
state rehabilitation agencies during each year of funding. 
These programs will significantly increase their compliance 
with the intent of the Rehabilitation Act and Federal Regu- 
lations through the application of performance standards. 
Policy and quality assurance systems will be operational 
and manager skills will be reflected through quality counselor- 
performance, consistency of rehabilitation services provided 
to handicapped people, and positive leadership behavi..>r„ 
To insure future dissemination and utilization, regiona] 
RSA offices and other potential regional resources will 
be encouraged to participate with project staff in the pre- 
paration and implementation of the management control system. 
Additionally, RCTP ' s located in the participating state's 
region will be provided the opportunity to observe the train- 
ing sessions and possibly utilize program material ^i^ in their 
curricula . 

Action steps to successfully install the management 
control system within an agency are: 

1 . Secure administrative commitment from participating 
state administrators. 
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2. Assure system ownership by agency top administration 
through developing a philosophical and conceptual 
understanding of the system and its applicability 

to the decision-making processes. 

3. Conduct organizational analysis. 

4. Negotiate recommendations and implementation strategies 
resulting from: 

a. Agency's mission, values, and expectations, 

b. Organizational analysis findings; and 

c. Concepts of effective organizational change. 

5. Complete negotiated prerequisite activities. 

6. Conduct management development training. 

7. Conduct counselor training. 

8. Support and reinforce system installation. 

9. Evaluate results of system installation. 

It is essential that project staff capitalize on the 
expertise of personnel from the original demonstration states 
for assistance in organizational analysis and system ipMo- 
mentation. It is also suggested that contact be maintained 
with these programs to gain additional insights as statewide 
installation is pursued. 
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Casework Performancs Standards and Criteria 
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Standard 1: 

95% of eligibility decisions will be accurate. 

A. Evidence of comprehensive diagnostic study 
with medical and/or psychological documentation 
of primary and secondary disabilities. 

B. Narrative description of how disability constitutes 
vocational handicap; physical and/or psychological 
limitations stated in functional terms. 

C. Narrative rationale that there is a reasonable 
expectation that vocational rehabilitation services 
may benefit the individual in terms of employability 
or that an extended evaluation is necessary in 
order to determine reasonable expectation of employ- 
ability • 

Standard 2: 

95% of closure decisions will be accurate. 

A. Documentation and rationale for closure and, as 
appropriate, evidence of the provision of substcuitial 
services . 

B. Documentation of client participation in thn closure 
decision and client notification of right of appeal, 
when appropriate. 

Standard 3: 

85% overall accuracy is required on IWRP development. 

A. Statement of, and rationale for, the vocational goal. 

B. Objectives and services described in IWRP are consis- 
tent with the functional limitations described in 
eligibility determination. 

C. Time frames established in the IWRP for each service. 

D. Evaluation criteria will measure the accomplishment 
of stated objective. 

E. Evidence of client involvement in the IWRP. 
Standard 4: 

95% accuracy is required in utilization of agency funds 
ind similar benefits. 

A. Expenditure of only those funds necessary for client 
evaluation and rehabilitation; expenditures consistent 
with agency policy. 

B. Similar benefits considered and utilized when appropriate. 
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MANAGEMENT CONTROL PROJECT FORUM 
OMNI INTERNATIONAL HOTEL 
ATLANTA, GEORGIA 

Movember 2-5, 198 2 



TUESDAY 
November 2, 1982 

3:00-5:00 p.m. FACILITATOR CAUCUS 



7:00-10:00 p.m. REGISTRATION /GET AQUAINTED HOUR 



WEDNESDAY 
November 3, 1982 

8:00-8:30 a.m. REGISTRATION /COFFEE 



8:30-9:00 a.m. WELCOME AND DISCUSSION OF FORUM OBJECTIVES 

Session will address the purposes of the 
forum, expected outcome and the relation- 
ship of the outcome to future Manacfement 
Control Project activities. 



9:00-9:45 a.m. ORGANIZATIONAL AND ENVIRONMENTAL FACTORS OF 

PILOT STATES 

Review of pertinent factors which led to the 
decision of the Georcria, Michiaan, and Maryland 
rehabilitation proarams to participate as 
Management Control Project pilot fjtates. 



9:45-10:00 a.m. COFFEE BREAK 



10:00-10:45 a.m. OVERVIEW OF MANAGEMENT CONTROL PROJECT RESEARCH 

AND DEMONSTRATION FINDINGS 

An overview of major research findings based on 
external case reviews, survey responses, indi- 
vidual feedback, and ancedotal data. 
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10:45 a.m.-2j45 p.m. THE EFFECTS OF THE PROJECT ON AGENCY STAFF 

Discussion a -jups will expxore the effects of 
the Manaaement Control Project on aaency staff. 

Groups will develop a listinn of positive and 
negative effects of the project upon three 
levels of staff (Counselor, Manager, Administrator) 
and orovide recommendations flowinq from each 
identifed negative factor. 



10:45 a .m. 
11:00 a .m. 
12:00 noon 
1:00 p.m. 
2:00 p.m. 



CHARGE TO DISCUSSION GROUPS 
DISCUSSION GROUPS 
LUNCH (on your own) 
DISCUSSION GROUPS 
DISCUSSION GROUP FEEDBACK 



2:45-5:15 p.m. 



THE EFFECTS OF THE PROJECT ON AGENCY CLIENTELE 

Discussion groups will identify the effects of 
the Manaaement Control Project on aaency clients. 

A listing of effects on clients will be develooed, 
It may be based on observation, data, or specula- 
tion. In addition to providing recoimnendations 
to alleviate any identified neaative factors, 
the nrouDS may suqqest hypotheses, criteria, or 
measures of client effects which should be 
considered. 



2:45 p.m. 
3:00 p.m. 
4:30 p.m. 



CHARGE TO DISCUSSION GROUPS 
DISCUSSION GROUPS 
DISCUSSION GROUP FEEDBACK 



5:15-7:00 D,m. 



DINNER (on your own) 



7:00-9:00 o.m, 



ERIC 



ORGANIZATIONAL PRF.REQU f. SITES FOR EFFFCTIVE 
MANAGEMENT CONTROT, SYSTEM IMPLEMENTATION 

Discussion nroups will explore prerequisites an 
orqanization must accomplish prior to the imple- 
mentation of the Manaqment Control System 

A listina of prerequisites 'aJ ona v;i(..;i rocommc^'ndations 
for their successful achievement will be developed. 
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7:00 p.m. 
7:15 p.m. 
8:15 p.m. 



CHARGE TO DISCUSSION GROUPS 
DISCUSSION GROUPS 
DISCUSSION GROUP FEEDBACK 



9:00 - 

9:00-9:30 p.m, 



SOCIAL HOUR 
FACILITATOR CAUCUS 



THURSDAY 
November 4, 1982 



8:30-8:45 a.m. 
8:45-11:45 a.m. 



RECAP OF YESTERDAY /DISSEMINATION OF GROUP REPORTS 



ELEMENTS OF AN EFFECTIVE MANAGEMENT CONTROL SYSTEM 
IMPLEMENTATION AND MAINTENANCE PLAN 

Utilizing fundamental management control system 
concepts, discussion groups will explore,^ essential 
elements of an effective installation and maintenance 
plan . 

GrouDS will complete a work plan outlining major 
tasks, strategies, and general time frames for 
successfully implementinn and sustaining thp 
Manaaement Control System. 



8:45 a m . 
9:00 a.m. 
11:00 a.m. 



CHARGE TO DISCUSSION GROUPS 
DISCUSSION GROUPS 
DISCUSSION GROUP FEEDBACK 



11:4 5-1:30 p.m, 



LUNCH (on your own) 



1:30-4:30 p.m. 



CRITICAL ORGANIZATIONAL ISSUES: PREREQUISITES, 
INSTALLATION, AND MAINTENANCE 

Issues needjno further investigation will be 
addressed during this session. An attempt will 
be made to identify issues specific to each 
group '.s ■ interest. 
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Thursday, November 4th continued. 



1:30 p.m. CHARGE TO DISCUSSION GROUPS 

1:45 p.m DISCUSSION GROUPS 

3:45 p.m. DISCUSSION GROUP FEEDBACK 

4:30-4:45 p.m. EXPLANATION OF EVENING ASSIGNMENT 

4:45 p.m. DINNER (on your own) 

5:00-5:30 p.m. FACILITATOR CAUCUS 

7:30 D.m. HOSPITALITY SUITE OPEN 



FRIDAY 
November 5, 1962 

8:00-8:15 a.m. RECAP OF YESTERDAY/DISSEMINATION OF GROUP REPORTS 

8:15-11:15 a.m. EFFECTIVE UTILIZATION OP MANAGEMENT PERSONNEL 

(Li:VEL I SUPERVISORS) FOR OPERATIONAL I ZING THE 
MANAGEMENT CONTROL SYSTEM 

Discussion aroups will have the opportunity to 
focus on the role(s) of the first line manauer in 
relation to staff under his/her supervision, manage 
raent skills necessary for effective performance, 
and areas of manager performance evaluation. 

Groups will complete a functional analysis of the 
position, identify skills necessarv to perform 
functions, and recommend methods of evaluatina 
manaaer performance. 

8:15 a.m. CHARGE TO DISCUSSION GROUPS 

8:30 a.m. DISCUSSION GROUPS 

10; 30 a.m. DISCUSSION GROUP FEEDBACK 

1.1 : 1. 5 - 1 2 : 0 0 noon PANEL REACTION 

This panel will discuss the forum outcomes achieved 
and their benefit to the Management Control i^ro'iect 
state/federal rehabilitation aqencies, and aaencv 
staff. An open discussion will fol.low the pane] 
Id reaction. 
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12:00-12:15 p.m. "BING REMARKS 

Focus will be on procedure for providinq additional 
input to the project following adjournment and for 
submittinq written evaluation of forum experience. 



Note: Coffee, juice, and soft drinks will be available throughout 
the sessions. Breaks will be scheduled before, during, and 
after discussion aroups, as appropriate, (This criterion 
will be evaluated, and reliability and validity scores reported.) 
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PROCESS ANALYSIS 127 

COUNSELOR REVIEWER 

CLIENT OFFICE_^ 

case/social security # , caseload type 

primary disability code date _ . 

eugTbiijiy 

A. Evidence of comprehensive diagnostic study with medical and/or psychological documentation of pnmary and secondary 
disabilities. 

REMARKS _^ YES^NO. 

B" Narrative description of how disability and any related factors constitute vocational handicap, physical and/or 
psychological limitations stated in functional terms. 

REMARKS Y£S/NO 

C. Narrative rationale that there is a reasonable expectation that vocational rehabilitation services may benefit the individual in terms 
of employability or that an extended evaluation is necessary in order to determine reasonable expectation of employability. 

REMARKS . . . - YiS/NO 

IWRP ' ~ 
A St<itwnu!n; of, and rationale for, the vocational goal. 

REMAl^K.S ^ _mS/NO 

B Objectives and services described in IWRP are consistent with the functional limitations described in eligibility determinaiion. 

REMAHKS _ — -YimO 

C liti n itainos established In the IWRP for each service. 

R^M.<XnKS ^ ^ - -^<^^ 

D fcvaluritfon criteria will measure the accomplishment of the stated objective. 

REMARKS __-.Y£S« 

F tviiienct) of client involvement in the iWRP. 

RF. ^/lA HKS . YES^lNO 

F I N A N f : I A I. TC COUNTABJ iTf Y ~ ' ~~ 

A tiKpciKliture of only those funds necessary for client evaluation and rehabilitation; expenditures consistent with agency policy. 

REMARKS — - — -jmS/NO 

R Sin i I ! , I r bTnlif i t s conside red and TItilized when appropriate. 

r:^:^P.Ks . YIS^NO 

A '..ioc.'iiT.enfation and rationale for closure and. as appropriate, evidence of the provision of substantial services. 



YES/NO 



R ' Ducuirientai'ion of client participation in the closure decision and client notification of right of appeal, when appropriate, 

YES/NO 



REMARKS 
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Self-Perceptions of 
Amount of Time Spent in 
Various Counselor Functions 



Dear Professional: 

This brief questionnaire is related to the research/ training 
objectives of the Management Control Project, The purpose of this 
effort is to determine the amount of time (self-report) that you 
spent in various professional activities. You will note that your 
name is already on the questionnaire since we will be asking you 
to cc.nplete this form again in about one year. Please trust , ^however , 
that your answers will be held in strictest confidence. And if you 
would care to call and discuss this task with me, please do not 
hesitate to do so. Thank you for doing thit, for us. 



Name 



Caseload: General 



City Special 

Date Completed ^ 



Please indicate the amount of time you spent in each of the 
following areas (an estimate). Your response should he 
expressed in percentages and should total 100%. (Estimates 
based on 1978 calendar year.) 



% of Time 



1. Administration/Supervision 

(includes preparation of reports, 
statements, conferring, reading, 
reviewing & analyzing information 
(related to administrative tasks) 

? . Evaluating 

(Includes assessmeni: of program 
activities and needs related to 
cannv;ork ) . 

3. Consultation/Referrals 

(related to referrals, conferences/ 
consultations, both within and 
outside agency). 
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4. Professional/Agency Development 
(activities related to program 
improvenient and/or self-improvement)* 

5. Client Counseling 

(includes activities of direct client 
services, eligibility determinations, 
counseling, IWRP development, assessment, 
case management, except job placement 
and follow-up). 

B. Job Placement and Follow-up 
(activities related to jobs — 
development, placement and follow-up). 

7. Recording and Reporting 

(includes dictating/writing reports, 
case notes). 



TOTAL: 100% 



Please return to: Timothy Field 

The University of Georgia 

Rehabilitation Counselor Training Program 

Management Control Project 

413 Aderhold 

Athens, Georgia 30602 
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SBLP-PBRCEPTIONS OP TIME SPENT 
IN VARIOUS OCCOPATIOMAL FONCTICWS 



The p™ of this surv^ i. to detemlne the »ount o* ^ VOU^ in 
»,rio«, .etivities r.l.ted to your Job. ,ctivlfieriSa~ 
veu beoln . This will acquaint you with ''"'■°"f in each catettory. 

Lch categ ory. Estlmte the percentage of time you ^"^^/SSa 
include travel time with the activity it supports. Your responses enou 



total 100*. 



At the end of the survey, please enter your f,^*^^;^^:^^ iS^tffi" 

Also indicate whether you serve a general ^^^^^P^^^*^^" ^^^^is fofthe 
cation of survey information will ^r.^t^reU^a^rbe^^^^ 
Manaoenent Control Project. Vour specific results wiii oe xepx. « 



% of Tir 



1. COONSELING AND GOIDftNCE 4*.., ^n^nf- and 

Pace-to^face and telephone interaction with ^^^i^"^!^ ^^f.^^.^ 
family meit*>era, intake interviews; counselino; interpreting, 
diagnostic dataj c-a^sijlting with clients at training or 
workshop sites, IWRP f emulation. 

2. RECORDING /REPOKP WRITING fiscal 

Case recording and dictation; form coripletion, fiscal 
processing, aging studies, coatplote management reports 

3. OVERALL PLAJ^NIMG OP WRK ^^naMltation, 

preplanning activities, tline management case consultation, 

staff meetings 

^"^or^velopment, specific client placement, Job analysis 
job follow-tip 

5. PUBLIC RELATIONS AND OOTREACM ^ ^«4.«^^;,i 

Making and preparing speQches/presentatxono, referral 

development, client advocacy activities, civic 
organlriation activities, consumer involvement 

6. PROPESSXCNAL GROWTH a^^-onf^^na 

inservice training, reading journal article, 
conferences, committee /task force activities, supervisory 

coaching 

7. COORDINATING SERVICES . _.4„4^«n4-a 

Resource/vendor de-zelopment, arranging appointments 
follow-UD activities, attending client staftings, 
medical consultation 



TOTAL 100% 



DATE 

NAME t ■ — ..^ — . — ■ — 



POSITION 

OTP ICE — t^oj-xx^-i^ 



CASeUM: General __ Specialty BEST CflPy AMIU BIE 
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Self-Perceptions of 
Amount of Time Spent in 
Various Occupational Functions 



Dear Supervisor: 

This brief questionnaire is related to the research 
objectives of the Management Control Project. The Purpose 
of this is to determine the amount of time you spend in 
various activities related to your job. Please P^t your 
name and office location on the form because we will be re- 
questing that you complete this foF^^efji^/^fj^^^l^ J con- 
be assured that your responses will be held in ^^jf 
fidence. If you wish to call and discuss this with me, please 
do not hesitate to do so. Thank you for doing this for us. 



Name 



Office 



Date 

Number of counselors supervised 



Please estimate the amount of time you spent in each of the 
following areas. Your responses should be expressed in per- 
ceitages'anSshiuld total 100%. Please base your responses 
on 1979 calendar year. 



1 . Fiscal Duties 
(Allocation of case service 
money to counselors, monitor- 
ing case service expenditures, 
approving unusal expenditures.) 

2. Administrative Duties 
(Completing ROP's; approving 
leave; insuring appropriate 
use of time; participating in 
staff hiring, promotion, and 
punitive action). 

r3. Staff Development Duties 

(Jeveloping individualized staff 
development profiles for unit to 
maintain and develop work-related 
skills, training new staff). 



% of Time 
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4. Public Relations Duties 
(Maintaining communication 
and relationships with refer- 
ral sources, vendors, and the 

general public), — 

5. Case Management 

(Quality assurance to maintain 
agency r^^licy; assistance to 
counselor; case reviews; assuring 
use of similar benefits and effic- 
ient use of case service resources; 
leadership in provision of quality 

services). — — — 

6. Consultative Duties 
(Functioning as liaison between 
state office and counselors, 

and between counselors and :"'ients 

as needed). 

7. Miscellaneous 

(Committee meetings for manual 

changes, etc.). — 

TOTAL: 100% 



Please return to: Adele Patrick 

University of Georgia 
Rehabilitation Counselor 

Training Program 
Management Control Project 
4.13 Aderhold 
Athens, Georgia 30602 
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SEU'-PEBCEPTIONS OP TIME SPENT 
IN VARIOUS OCCUPATIONAL FUNCTIONS 

The purpose of this survey is to determine the ainount of time you spend in 
various activities related to your job. Please read the ent ire survey before 
you begin . This will acquaint you with the various activities included in 
each category. Estimate the percentage of time you spend in each category. 
Include travel tiine with the activity it atpporta. Your ^responses should 
total 100%. 

At the end of the survey* please enter your na»e» office, position, and date. 
Also indicate the number of staff directly under your supervision. Identifi- 
cation of suivey inforaation will be used only to compare resvats for 
Management Control Project. Vour specific results will be kept ccjnf idential. 

% of Time 

1. BUDGET MANAGEMENT 

Allocation of case service money to coianselors, monitoring 

case service budgets, managing ttaval and budgets . 

2. ADMINISTRATIVE DUTIES 

Approving leave; scheduling staff time /activities; partici- 
pating in staff hiring, promotion, disciplinary action, and 
performance appraisals- condiicting/attending staff meetings, 
task force or committee assignments _^ 

3. BTPCF? DEVELOPMENT DUTIES 

Maintaining individualized staff development pliina fOS 

office and providing individual staff training 

4. PUBLIC RELATiaJS DUTIES 

Maintaining communication and relationships with referral 
sources, vendors, consumer gro\:^s, legislators, employers 
and the general public : 

5. CASE MANAGEMENT 

Quality assurance to maintain agency policy; case revj«^s; 

"-,f$,i of casework; assuring use of similar b*'»-=*its 
and efficieaiu uoo n»tia pprvice reaoiiro*'* 

6. CONSULTATION DUTIES 

Provide coaching and feedh*-''^ with counselors and or 

other staff regarding *jilent service delivery. Function 

as liaison betvraen orfices. 

TOTAL 100% 



WAMB ; . I, .■■ p A'i'f:; ! 

OFFICE' POSITION! t 



Ntmbor of staff directly under your supervision 
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Self-Perceptions of 
Amount of Time Spent in 
Various' Occupativmal Functions 



Dear Secretary: 

This brief questionnaire is related to the research 
objectives of the Management Control Project. The purpose 
of' this is to determine the amount of time you spend in 
various activities related to your job. Please put your 
name and office location on the form because we will be re- 
questing that you complete this form again next year. Please 
be assured that your responses will be held in strictest con- 
fidence. If you wish to call and discuss this with me, please 
do not hesitate to do so. Thank you for doing this for us. 



Name 



Office 



Date 



Do you work for caseload counselors 

supervisors 

facility counselors ^ 

Please estimate the amount of time you spent in each of the 
following areas. Your responses should be expressed in per- 
centages and should total 100%. Please base your responses 
on 1979 calendar year. 

1. Financial/Statistical Reporting i_£L.Ii!H£ 
(Maintaining weekly and monthly 

reports relating to case manage- 
ment (A/I's, WCER, travel expense 
statements, R-lOO, Imprest Bank 
Account, etc.). Case processing 
forms (Case Progress Report, 
Application for Services, DVR 100, 
Facility Authori7.at ion-Referral 
Form, 1407, 1407-A, 1408, DOT, 
California Relative Value Studies, 

Suspense File, "Black Book", etc.) 

2 . D 1 c t u t iona 1 /Tr anscr j.p 1 1 onal 
(Case h i s t. o r i e s , c o r r c; s r o n d e n c e , 
appointment letters, requests for 

modical information, TWRP forms) 
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3, Receptionist 

(Answering telephone as needed; 

acting as liaison between office 

personnel, counselors, and clients; 

general information to public. ) 

4, Miscellaneous 

(Maintains counselor card files 
on clients, desk file of VR statis- 
tical forms, counselor file of case 
folders, open and closed case files. 
Handling in-coming and out-going mail. 
Maintaining leave cards. Maintaining 
VR manuals. Attending division meetings, 
workshops, training programs as requested.) 

5, Secretarial/Aide Duties 

(Acts as liaison between counselors 

assigned to her and their clients. 

Making client appointments, providing 

client transportation, maintaining case 

records for proper coding, case flow, 

A/I vt^rif ication , etc.) — 

TOTAL: 100% 



Please return to: Adele Patrick 

University of Georgia 
Rehabilitation Counselor 

Training Program 
Management Control Project 
413 Aderhold 
Athens, Georgia 30602 
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SELP-PERCEPTIOMS OF TIME SPENT 
IN VARIOUS OCCUPATIONAL FUNCTIONS 



The ourpoae of this survey is to determine the amount of time you spend in 
various activJ ties related to your job. Please read the entire aurvey before 
you becTin . Tlds will acquaint you with the various activities included in 
each category . Estimate the percentage of time you spend in each category. 
Include photocopy work and travel time with the grouping th^sy suoport. Your 
responses should total 100%. 

At the end of the 3urvey, pl«Q»e enter your name, office, position and date. 
Also indicate whether you work for caseload counselor, supervisor, or other. 
Identification of survey information will be used only to cowpara results 
for the Management Control Project. Your specific results will be keot 

confidential e 

% of Tiwe 

1. FISCAL/STATISTICAL KBPORTP^G 

Maintaining Weekly or monthly reports relating to case 
management; completing fiscal /statistical forms, validating 
billing docunents, preparing travel vouchers, bu» ticket record 

CtCw 



2. DICTATIO^?/TRAfl^SCRIPT^0K 

Case histories, correspondence, apoointment letters, 
requests for medical information, 1^«RP forms, ewmos 

3. FECE'PTIOHIST DOTIES 

Answering phone? acting as liaison between office 
rjersonnei, counselors and clients » giving general 
information to public; maintaining visitor logs 



4. AIDE DOTIES 

Making client appointments, arranging client trans- 
portation, scheduling diagnostic exams, distributing 
direct pay checks or bus tickets, maintaining follow-up 



5. MISCELLANEOUS 

Filing, handlirig incoming and outgoing mall, main- 
tainirig manuals, attending staff meetings, workshops 
or training programs, ordering office svflppltos, 
maintaining card files 

TOTAI, 100* 



NAftE : [ 

OFFICE . POSITICWi 

WORK FOR: Caseload Counselor Supervisor _ Other 
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Definition of LBDQ Subscales 

Each subscale is composed of either five or ten items. 
A subscale is necessarily defined by its component items, and 
represents a rather complex pattern of behaviors. Brief defi- 
nitions of the subscales are listed below: 

1. Representatio n - speaks and acts as the representative of 

the group. (5 items) 

2. Demand Reconciliation - reconciles conflicting demands and 

reduces disorder to system. (5 items) 

3. Tolerance of Uncertainty ~ is able to tolerate uncertainty 

and postponement without anxiety or upset. (10 items) 

4- Persuasiven ess - uses persuasion and argument effectively; 
exhibits strong convictions. (10 items) 

5. I nitiation of Structure - clearly defines own role, una lets 
„ followers know what is expected. (10 items) 

6. Tolera nce of Freedom - allows followers scope for initiative, 

~ decision and action „ (10 items) 



J U; 



7 Role Assumption - actively exercises the leadership l- 

— ' " rather than surrendering leadership to other?-: 

(10 items) 

8. Consideration - reqards the comfort, well being, status, 

"and" contributions of followers. (10 items) 

9. Productd^on_E^ - applies pressure for productive 

output, (id items) 

I, 0. Predj^tiye__Acc\ira£y - exhibits foresight and ability to 

predict outcomes accurately. (5 items) 

II. Intcqration ~ maintains a closely knit organization; 
resolves intermember conflicts „ (5 items) 

12. Superior Orientation - maintains cordial relations with 
'""superiors; has influence with them; is striving 
Eor higher status. (10 items) 
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LEADER BEHAVIOR DESCRIPTION QUESTiONNAIRE-Form Xli 



On the rollouing pa^'.os is a list of items that imy be used to describe the behavior of your 
supervisor. I iich iiein U'. scniies a specific kind of behavior, bui does not ask you to judge 
whether the tn'hiivior n tesii.'ble or undesirable. Aiih-^ugh soi lo items may appear similar, 
they express ilifleiencrs ihal ^ru i.u{ urtant in Ih-' dts:i. iIdi ,f leadership. Each Item should 
be ioiisidei'.Hl .» . ;i h| \a e i'es;r.pt on. This is H)t a um i/f ability or consistency in making 
answers lis wi^iy i^;m ) . :'istoM.ikt .t possible foi you lo describe, as accurately as you can, 
the bchi Vh)' s UH iii'-ervist)!". 

Nolo: l he u I ii> ■ iin.'nn. ' as employe J in the following items, refers tua department, division, 
or oilui unif ol i- i/:iiion ihai is supervised by ihc person being described. 

Th--; (eini ''nirtnhffw/ r.^feis to nil the people in the .:n;i ot organization that is supervised by 
the pcisufi bcnii' desuihed 



Originated by staff members of 
The Ohio State Leadership Studies 
and revised by the 
Bureau of Business Research 



Purpose of the Qnest 'umnah'e 



Puhlishal hv 



College of Administrative Science 
The Ohio State University 
Columbus, Ohio 



Copyright 1962, The Ohio State University 
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DIRECTIONS: 

a. RF.AD each ilem catefiilly. 

b. THINK about how frequently the leader engages in the behavior described by the item. 

c. DECIDE whether he/she (A) always, (B) often, (C) occasionally, iD) seldom or (E) ne.cr acts as 
described by the item. 

d. DRAW A CIRCLE around one of the five letters (A B C D E) following the item to show the answer you 
have selected. 

A = Always 
B = Often 
C = Occasionally 
D = Seldom 
E = Never 



c. MARK your answers as shown in the examples below. 

l-xample: Often acts as described 

Example; Never acts as described 

Exjiinple: Occasionally acts as described 



A (B) 
A B 



A 
A 
A 



. A 

. A 

,. A 

. . A 

. . A 

. . A 

. . .\ 

. , /\ 



B ' 
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1. .\cts as the spokesperson of the group 

Wails patiently foi the results of a decision 

3. Makes pep talks to stimulate the group 

4. Lets gr(Mip members know what is expected of them 

^ AlU'ws the mcmhcis complete tVecdom in their work 

6. In hesitant about Uiknig initiative in the group 

7. Is liicndly and approuohable 

H l■'.nc"llraL'x•^• ovcitune \\orK 

*J Ma'':''- accuraU- decisions 

Id. f.cts ,,h^ng ut;|l vMth liic p.' 'nlc abo'.c hnvhei 

I I. piihlki/c. Ill'' .tctivitius or -ho group 

i: n,co.nes auMou:. uhcn ^lic cannot llnd .^ul what r^ comiun ne.st 

i62 



B 
B 
B 
B 
Li 
H 
1^ 
B 
B 
B 
B 
1^ 



IJ 

1.) 
D 



1) 
I.) 
I) 

n 

I.) 

\) 

I) 

I) 

I) 

1) 

I) 

!> 
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A - Always 
B = Often 
C - Occasionally 
D = Seldom 
H = Never 





A 


B 


C 


I) H 




A 


B 


c: 


L) I- 


t - 11 ■* .^^..t^AK*-»rc tn iic*^ thf*ir own iiid2ment in solving problems . . 
Permits the mcmncrs lo use uicn uwm juu^iuvm c t 


. A 


B 


c 


D l.^ 




A 


B 


c: 


n H 


i wi , . ♦ ^ r,t*iL'*» It r>ir»'»c^inf t(\ h^* M momber of the croup . . . . 
17. Does little things to muKe ii picasani lu vc a m^niuti vm ^^ivm^ 


A 


B 


c: 


I) H 


IK. stresses toeing cuieau oi cunifjuiMi^ ^is^v»p.^ 


A 


B 


c 


I) E 




A 


B 


c 


D F, 


?(). Keeps ine gioup iii gvHJu MiuiuMiti vyhh nij^ns/i 


A 


B 


c 


D l- 




A 


B 


c 


1.) H 




A 


B 


c 


D I--. 


Argues pc.siiasiveiy lor nis/nci puim yn \iv.w 
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:U. Speaks tor the ^roiip svhen visitors are present 
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Is a very peisiMsive talker 
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34. Makes his/her altitudes clear lo the group 
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u, l.cts some members take advantage of him/her 


, . A 


Ii 


f 


\1 1 












148 


A = Always 










B - Often 










C ^--^ Occasionally 










D Seldom 










E - Never 












A 


B 


C 


D E 


38. Keeps the work moving at a rapid pace 


. A 


B 


C 
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A 


B 


c 
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40. His/her superiors act favorably on most of his/her suggestions 


A 
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Asks the members to work harder 
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M). (icts his/htM- supciiors Id act tor Iho welfare of the group members, . 
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B 
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BEST COPY AVIlWtE 



A --• Always 
B - Often 
C = Occasionally 
D Seldom 
F, ~ Never 

61. (lets swamped by details 

6:. Can wait just so long, then blows up 

63. Speaks from a strong inner conviction 

64. Makes sure that his/her part in the group is understood 

by the group members 

65. is reluctant to allow the members any freedom of action . . . 
6o. Lets .some members have authority that he./she should keep 

67. Looks out for the personal welfare of group members 

6:s. Permits the membeis to ^.ke it easy in their work 

6'). Sees to it thai the work of the group is coordinated 

70. His/h'M- word carries v/eight with superiors 

7L Ciets things all tangled up 

12. Remains calm when uncertain about coming events 

'3. Is an inspiring talker 

M. Schedules the work to be done 

75. Allows the group a high degree of initiative 

76. lakes full chaigc when emergencies arise 

77. Is willing to ,nako changes 

7X. Drives hard when there is ajob to be done 

79. Helps gioup incnihers selllc their differences 

SO. (iets uhal he/she asks h.r from his/her superiors 

S| Ciiii leducc a madhouse to sv^tem and order 

K2 Is able to delay action imtil the pioper lime oceuis 

K<. I'eiMiades others tOat his/her ideas are to their advantage 
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A = Always 
B = Often 
C = Occasionally 
D = Seldom 
E = Never 
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91, Gets confused when too many demands are made of him/her 
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94. Asks that p members Ibllow standard rules and regulations . . . 
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.1 ^ I 



Indices of Alien xtion* 



Sub scales * ^ 

Alienation from Work 
(If^^is 1-6) 
Scored 1--4 

Alienation from expressive 
relations 

(Items 7-8) 

Scored 1--4 

Index of h.-ierarchy of 

authority 

(Items 9-13) 
Scored 1-4 

Index of particip*=ition 
in decision making 

(Items 14-17) 

Scored I'-^B 

Index of job codification 
(Items 18-22) 
Scored 1--4 

Index of rule observation 
(Items 7/\-7A\ 
.Scoied 1 -4 



A feeling of disappointment with career 
and professional development and inability 
to fulfill professional norms. 

Dissatisfaction in social r'.lations with 
supervisors and fellow workers. 



The degree to which staff members are 
assigned tasks and are given freedom to 
implement without supervisory interruption, 



The degree to which staff member partici- 
pate in setting goals and policior. of the 
organization . 



The degree to which there are rules 
defining jobs and specifying wha^: is ho 
be done. 

The degree to which rules are enforced. 



^Aiken, M. and Hage, J. Organizational alienation: A camparati^■^ • i 
Ame^rjTjan ^ocJ.ol^^ .1966, 11, 4Q''7"507. 

*^0n each sul^^scalo, higher scortis indicate more alienated rei;po\i,^--s whil<^ 
lower f>coros indicate lecjs alienatcuJ rer,ponseG. 
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SOCIAL SECURITY NO. 

NAME - — 



ERIC 



JOB TTTLE — DISTRICT OFF 10 2 _ 

n.ase Check the answer that bast reflects your perception of your work environment, 

X. How satisfied are you that you have been given enough authority by agency 
management to do your job well? 

1, Very satisfied 
"2. Somewhat satisfied^ 
"3. Somewhat dissatisfied 



"u. Very dissatisfied 



2. 



•how satisfied are you with your present job when you compare it to similar 

positions in the state? 

1, Very satisfied 
' 2. Somewhat satisfied^ 
3. Somewhat dissatisfied 



3. 



\. Very dissatisfied 



How satisfied are you with the progress you are .aking towards the goals 
which you set for yourself in your present position? 



1, Very satisfied 

"2. Somewhat satisfied 

■■3. Somewhat dissatisfied 

"u. Very dissatisfied 



professional expert to tne at-gtet. i.^ j 
position, training and experience? 

1, Very satisfied 
~2. Somewhat satisfied 
"3. Somewhat dissatisfied 



the expectations you had when you took this 30b- 

1. V^'i-y satisfied 
'2. Somewhat satirjfied^ 
■3. Somewhat diosat isf ied 



't*. Vury diosatinf ied 

whole, how satisfied are you with your present job when you consider 



''u. Very dir^Gritisfied 
r,,U,fiod are you with your present job in Ugh. of career expectations? 

1. V»jry satisfiod 
"2. Somewhat satisfied 

Som.-:what disr.atisf ied 
~u. Vfiry ''li?:satisf i&d 
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7. How sc^tisfied are you with your supervisor? 

1, Ver-y satisfied 

2. SoiHewhat satisfied 

3* Somewhat dissatisfied 



"^4, Very dissatisfied 



8. How satisfied are you with your fellow workers? 
1. Very satisfied 



2. Somewhat satisfied 
y. Somewhat dissatisfied 
""u. Very dissatisfied 



9. There can be little action taken here until a supervisor ai nroves a decision. 

^1. Definitely false 

2. Somewhat false 

^3. Somewhat true 

4. Definitely true 



10. A person who wants to make his own decisions would be quickly discouraged here. 

^1. Definitely false 

2. Somewhat false 

3. Somewhat true 

4. Definitely true 



11. Even small matters have to be referred to someone higher up for a final answer • 

^1. Definitely false 

7. Somewhat fal^e 



3. Somewhat true 
"4. Definitely true 



12- I have to ask my boss before I do almost- anything. 

^1. Definitely false 

2. Somewhat false 

3 . Somewhat true 

" Definitely true 



L3. Any decision I make has to have my boss' approval. 

^1. Definitely false 

2. Somewhat f. Ise 

3. Somewhat true 
""II Definitely true 

lu. frP'i'.;^»ntly do you usually participate in the decision to hire new staff? 

^1. Never 

2. Seldom 

:u Sometimes 
Often 

S . Alv/ay ^ 
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15. How frequently do you usually oarticipate in deMsionr, on the promotion 
of any of the professional staff? 

^L, Never 

" 2, Seldom 

3, Sometimes 

' u . Often 

5. Always 



How frequently do you participate in decisions on the adoption of new policies? 
1. Never 



"2. Seldom 

'3. Sometimes 

"4. Often 

"5 . Always 



17, How frequently do you participate in the decisions on the adoption of new 
programs? 



1. Never 

~2. Seldom 

"3. Sometimes 

"4. Often 

~5. Always 



18 



I feel that I am my own boss in most matters 

1 . Definitely false 

2. Somewhat false 

3. Somewhat true 
^4. Definitely true 



i,. A person can make his own decisions without checking with anybody else. 



1. Definitely false 

'2. Somewhat false 

"3. Somewhat true 

"u. Definitely true 



20. How things are done here is left up to the person doing the work, 



1. Definitely false 
"2. Somewhat false 
~3. Son.ewhat true 
Definitely true 



1 ^ 



Peof.ie hRre are allowed to do almost as they please 



1. Definitely false 

"2. Somewhat false 

'3. Somewhat true 

~i4. Definitely true 
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22. Most people here make their own rules on the job, 

I, Definitely false 

2* Somewhat false 

3. Somewhat true 

Definitely true 

23. The employees are constantly being checked on for rule violations. 

^1. Definitely false 

2. Somewhat false 

^3. Somewhat true 

H, Definitely true 

24. People here feel as though they are constantly being watched* to see that 
they obey all the rules. 

^1. Definitely false 

■~ 2, Somewhat false 

3 . Somewhat true 

4, Definitely true 
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Management Control Project Forum 
Issue Summary 



Issue A: The Effects of the Project on Agency Staff. 

During the pilot states' initial orientation to the 
Management Control Project, several staff-focused objectives 
were outlined. Based on experience as a project participant, 
staff selected to attend the forum were asked to indicate 
whether these objectives had been "met" or "not met." This 
exercise was completed prior to the forum and served as a 
stimulus for group discussion. Responses are reflected in 
the following table. 



THE EFFECTS OF THE MANAGEMENT CONTROL PROJECT ON 

AGENCY STAFF 

Not ^ No 
Objective Met Met Both Respo n se 

Rehabilitation Counselors 97.2% 2.8% 

will increase accuracy in 
meeting federal eligibility, 
IWRP, and closure require- 
ments. 



2. Rehabilitation Counselors' 77.8 8.3 5.6 8.3 

decision-making responsi- 
bility and authority will 
be clearly delineated. 



3. Rehabilitation Counselors 44.4 36.1 2.8 16.7 

will experience greater 
job satisfaction due to 
increased authority and 
responsibil ity . 



4. Rehabilitation Counselors 30.6 36.1 2.8 30.6 

will feel less work 
al ienation . 



*Respondents circled both possible responses. 
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5. 



6. 



7. 



Objective 

Rehabilitation Counselors 
will have more time (post 
MCP) for meaninqful client 
contact due to increased 
emphasis in client 
involvement and reduction 
in case recording and 
general paperwork 
requirements. 

Manager roles will be 
refocused to emphasize 
coaching, consultation, 
and staff development. 



Secretaries will experi- 
ence less "paper" demands 
allowing for potential 
position restructuring. 



Met 



Not 
Met 



Both 



No 

Response 



27.8 58.3 



5.6 8.3 



50.0 33.3 



8.3 8.3 



19.4 52.8 



2.8 25.0 



Discussion groups addressed the effects the Management 
Control Project has had on three personnel categories, i.e., 
rehabilitation counselors, rehabilitation managers, and 
rehabilitation support staff (clerical) . The following 
effects were reported: 

MCP Effects on the Rehabilitation Counselor: 

1. Agency and counselor goals become more congruent. 

a. Agency mission and values are clearly communicated? 

b. Agency expectations understood through the estab- 
lishment of performance standards; 

c. Direction provided through the development and 
dissemination of clear and concise policy; 

d. Participatory management focus is demonstrated _ 
through counselor involvement in the goal setting 
process and increased decision-making responsibility 
and authority; . . 

e. Administrators and managers provide positive rein- 
forcement; ... 

f. Pressure to produce has become self-mitiatea ratner 
than agency- initiated; 

g. Consistent and constructive feedback on performance 
provided by manager; and 
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h. General feeling toward aqency is improved. 

2. Counselor /supervisor relationship improved. 

a. Valued feedback is received on performance from 
supervisor; 

b. Supervisor understands the work of the counselor; 

c. Supervision is provided in relation to actual counselor 
competencies; 

d. Case review process is more consistent and meaninqful; 
and 

e. Common under titanding exists for case decisions. 

3. Counselor/client relationship improved and provision of 
services enhanced. 

a. Clients have ownership in their rehabilitation 
program due to increased involvement in its develop- 
ment ; 

b. Client appeals have declined due to better under- 
standing of rehabilitation process and better 
counselor decisions; 

c. System emphasizes client /counselor relationship; 

d. Counselor must know client to develop an effective 
IWRP ; 

e. System provides the oppi^rtunity to work with people 
rather than paper; 

f . Counselors have increased confidence when explaining 
services to clients; 

g. Counselors have a strong base for their decisionb 
and are not intimidated by client appeals or 
legislative inquiries; 

h. Counselors and clients are more confident of 
projected outcome; 

i. Client moves through rehabilit.atioa process appro- 
priately and usually more rapidly; 

j. System forces counselor to focus on client's 

abilities; and 
k. Client receives more professional evaluation, 

4. Counselors demonstrate high performance when given 
responsibility and authority for decisions. 

a. Eligibility decisions consistent with congressional 
intent; 

b. Programs demonstrate change from entitlement focus 
to eligibility focus; 

c. Clients are more confident in program developed; 

d. Dramatic increase in all performance areas demonstrated; 

e. Redundancy reduced, accountability increased; 

f. Improved communication with referral sources, vendors'; 
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advocacy groups, and legislators; and, 
q. Opportunity to realize personal responsibilitv for 
decisions appreciated and results in improved imorclle, 

5. Concerns expressed. 

a. Followinq project installation, agency operation 
must remain consistent with MCP philosophy; 

b. Mixed messages given — counselor must decide, but 
decisions are challenged; 

c. Documentation increases requiring more paperwork; 

d. Little input on production; 

e. Counselors desiring dependency relationship with 
supervisor ar6 uncomfortable with system; 

f. Semantics of system causes breakdown between 
counselor and supervisor; 

g. Supervisor's review of IWRP is too precise; 

h. Counselors more comfortable with system than 
supervisors; 

i. Supervisors must learn to give constructive feedback; 
j. Counselors have more decision-making responsibility 

but fear "no" ratings on case reviews; 
k. Review may ignore important casework issues in 

looking for strict adherence to case review criteria; 
1. Policy and controls may again replace competent 

supervision and good management practices; 
m. Independent counselor status - threatening; and 
n. Rater reliability and validity questioned. 



MCP Effects on the Rehabilitation Manager: 

1. Manager /counselor relationship enhanced. 

a. Increased involvement with cases; 

b. Better understanding of counselor role; 

c. More sensitive to staff problems; 

d. More accountable to provide resources; 

e. Increased commitment and involvement in achieving 
agency and counselor goals; 

f. Demonstrating increased flexibility; 

q. Providing better consul tatio coaching, and develop 
mental exneriences; 

h. Less "we-they" segregation; 

i. Demonstrating increased confidence in staff to manage 
caseload expenditures; 

j. Providing better employee performance appraisals; 
k. Communication with counselors increased; 
1. Trust demonstrated; 

m. Positive reinforcement and recognition provided; 
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n. Less questioning of professional decisions mado 

by counselors; and 
o. Feedback is consistent. 

2. Management role skills enhanced. 

a. Supervisors are more accountable and knowledgeable? 

b. Coaching skills valued; 

c. Better able to articulate policy; 

d. Provides consistent implementation of p-^licy; 

e. Increased legislative and public credib '.lity and 
accountability; and 

f. Community image enhanced. 

3. Additional needs expressed. 

a. Ability to effectively manage change; 

b. More clearly defined role; 

c. Increased emphasis and skill development in arpas 
of : 

1. Coaching, 

2. Monitoring, 

3. Consulting, 

4. Behavior analysis; 

d. Time to perform all duties; and 

e. New criteria for selecting supervisors. 

4. Concerns expressed, 

a. Fear of having to defend decisions; 

b. Role uncertainit-y ; 

c. Loss oi" authority; 

d. Lack oi trust; and 

e. Threatened, 



MCP effects on Support Staff 

1. . Positive expressions. 

a. More goal oriented; 

b. More assertive to ^referral sources; 

c. All eligibility decisions referred to counselor; and 

d. Decrease in paperwork. 

2, Concerns and negative expressions. 

a. Increased pressure to complete work quickly .;ue to 
reviev; process; 

b. Typing demands increased due to documentation 
requirements; 

c. Job freezes compound workload assignments. 
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Recoinmendations 

1. Following project installation care must be taken in 
relation to; 

a. Agency operations remaining consistent; witb KCP 
philosophy; and 

b. Policy development to assure that unnecessary controls 
do not re-enter system. 

2. Realistic balance between "numbers" and "quality" detormined; 

3. Assure commitment of top administration; 

4. Drop mention of independent status; 

5. Drop mention of decreased paperwork; 

6. Market realistic ijositive aspects— sell need for MCP-- 
information on Federal Regulations and survival; 

7. Provide on-going in-service training on "how-to-do-steps;" 

8. Develop the supervisor as coach, trainer, reviewer, etc., 

9. Insure two-way communication; and 

10. Provide ample grace period to accomplish the above. 
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Issue B: The Effects of the Project on Agoncy Clientele. 

Due to the time span in which pilot states have partici- 
pated in the project's demonstration, hard data on client 
outcome has not been generated. Forum participants addressed 
the effects of the project on their clients based on obser- 
vation, data, or speculation. Positive findings were pre- 
dominant and within the six groups discussing this issue, 
the following were the only statements expressed which some 
viewed as concerns: 

1. IWRP language too esoteric for clients; 

2. Clients do not understand IWRP; 

3. Procedures from referral to closure are slower; and 

4. Not as many "easy" clients. 

The following were >-eported by the groups resulting 
from their discussion: 

1. Eligibility and program development decisions more 
appropriate due to MCP emphasis on the counselor's 
diagnostic skills. 

a. Diagnosis is more in-depth; 

b. Functional limitations assessed more accurately; 

c. More substance available for good decision-making; 

d. Better up-front decisions are being made; 

e. Clients are screened more intensively;^ 

f. Greater honesty with clients in explaining rehabili- 
tation potential; 

g. Clients are participating in eligibility determin- 
ation and have greater understanding of potential 
and program; 

h. Client needs are identified much earlier; 

i. Better diagnosis leads to better services; and 

j. Very clear decisions possible and being made regarding 
^eligibility and ineligibility. 

2. Clients' rehabilitation program uevelopment and provision 
of services improved. 

a. Developed program of services meets client needs 
rather than sterotyping by disability categories; 
D. Clients have, more equitable access to services; 

c. Service delivery is faster; 

d. Writing IWRP ' s in client's language, therefore, 
better understood; 

e. Better program development and service delivery 
for handicapped clients; ^ 

f. Able ti give more attention to clients, particularly 
severely handicapped, due to serving only eligible 
clients ; 
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g. Counselors no longer insurance agerits and supplioi. :i 
of incidental services due to emphasis on providing 
S G IT V 1 C (f^ S directed toward meeting client needs and 
achievinq ^^ocational qoal; 

h. Counselor better able to do job placement; 

i. IWRP's are thorouahly developed; and 

j. Counselors are not overlooking as many things; 
ambiguities have" 'decreased • 

3. Client involvement and responsibility in rehabilitation 
program development and service provision has increa:-irci , 

a. Clients are more aware of overall rehabilitation 
process; 

b. Clients understand and assu.ne responsibility for 
their rehaln 1 itation program; 

c. Appeals ha^'p greatly decreased; 

d. Client participates in program changes; 

e. More ioint counselor /client cooperation; 

Clients arc confronting their functional limitat Mjns 
and realizing their assets; and 
a. Client owno-':-ship of their program has Increased,. 

4. Outcomes sopr. positive* 

a. Consisl:(;-n( Y i^jquals fairness to client; 

b. Clients get better placement services; 
c* r I J.ent recidivism is decreasing; 

d. Agency rc^sources going to eliqa.ble olientnt 

e. ci. ieni- knov/s expectations; 

f. Client better inform^^d; 

Pev;or cLionts being set up for fa.ilure; 

h. Client sees counselor as rnorf-.: creditable; 

i. Outcom(: qoal^^. of counseling process better detinpH; 
and 

). C'l ..Rill, aiid rnfnrral sourer^ havr; more rr3al:si:.ic 
ej^pccttVi tions of agency. 

5 . Recommendation s . 

a. Comparison of "26^s'* and ^*28*s*' needed to identify; 
why outcomt-^ is different; 

Assosn rn.i-'-.nt attitudes reaardina proqram; 

c. Consj.dor d.*voloping a rrTirrative IWPP; 

d. Increase training and practice; 

e. Educ^a^-'} ir^ff^rral sources and the community; 'ii>d 
P Tncre..i .:e co«-.nerative aqreemnnts and linkage wi th 

other resources . 
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Issue C; Organizational Prerequisites for Illffectivo 
Management Control System Implementation 

Discussion groups explored prerequisites an organisation 
must accomplish prior to the implementation of the manage- 
ment control system. The following represents feedback 
from the groups: 

1. Agency administrators must make a commitment to practice 
the philosophy and concepts advocated by the MCP, 

a. Agency must have total commitment; there is tendency 
to underestimate time^ money ^ other resources needed 
to fiee project through; 

b. Management must commit to a long-term process^ not 
an overnight change; 

G. Top management must be willing to take risks; 

d. Commitment is needed throughout the agency, top 
to bottom; and 

e. Managers must understand the philosophy of the system. 

2. Agency administrators must develop and communicatv.- the 
organization's mission, values, and expectations. 

a. Agency must establish mission statement and organi- 
zational goals; and 

b. Agency must clearly define objectives and communicate 
them t' everyone in the organization. 

3. Agency administrators and system planners must uLiliiie 
pilot experiences. 

a. Evaluate results and methodology of system implemen- 
tation in pilot offices and other pilot states-- 
investigate what has been done: and 

b. Utilize a pilot experience beforf^ implamentina 
s tatowide. 

4. Agency administrators must nianacje change ef f ectJ.vel / * 

a. "i;. took 50 yer»rs to create the Cormer system, it 
will take many years to change;:;" 

b. Involve all staff in implementation plans to develop 
an ownership of the system; 

a. Develop supHr^/isory skills in being effective inanaqo^r.^^ 
of change and change agents; 

d. Address staff attitudes and determine readiness 
for change; and 

e. Develop strategies for internal marketing. 

Assurf^ that agency policios and procedures are consistent 
wi th phi losophv * 
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a. Eliminate policy inconsistencies prior to system 
implementation phase; 

b. Develop system of resolvinq policy omissions and 
errors; and 

c. Develop system of policy dissemination to field 
staff . 

6. Additional thoughts on system development and adaptati.on. 

a. Aciency must be willing to provide adequate first- 
line supervision ; 

b. Develop understanding of chanqes at all levels of 
organization; 

c. Agency must be willing to forego the pressure of 
meeting production quotas — won't initially have 
quality and quantity; 

d. Detennine costs; 

e. Determine time schedule; 

f. Determine pilot areas; 

g. Develop system of feedback; 

h. Develop incentives for good behaviors; 
i* Define staff roles; 

j. Insure sufficient resources; 

k. Allow araje period for system to settle; 

1. Build in time to "hash out" problems and questions; 

m. Training 

1. Provide supervisors adequate training for 
coaching role ; 

2. Include counselors who have worked under system ? 

3. Prepare to address staff problems resuJting 
^rom MCP implementation; and 

4. Counselor training must be practical, 

7. Standardize management philosophy nat ionwide--allQW 
system to evolve and compare with oJher states. 
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Issue D: 



p:lenients of an Effective ManagemGnt Control 
System Tmplementation and Maintenance Plan. 



Utilizina fundamental management control system concepts, 
discussion groups explored essential elements of an effective 
installation and maintenance plan. The followinq elemen'.H 
were reported: 

1 . Implementation. 

a. Commitment of top management; 

b. Clarification of agency values? 

c. Definition of sta roles; 

d. Effective management of change: informal and formal 
m.arketing by the agency creating staff commitment; 

e. Ccmmunitv education; 

f. Acquisition of skills for* new roles 

1. Negotiation training; 

2. Rater training, i.e., develop reliabil ity /validity ; 

3. Supervisory training in coaching skills, i.e., 
staff development skills; 

4. Comraunication ; and 

5. Casework; 

g. Determined and disseminated standards of performance; 

h. Evaluation procedures; 

i. Monitoring and feedback; 

j. Identify necessary resource materials; 
k. Develop objectives; 
1. Develop policy system; 
m. MIS match- up; 

n. Review of forms/design of new forms; 

o. Realistic time frames; 

p. Forma] ized feedback loops; 

q. Resource allocation ($, staff: to adequately commit-. 

to implementing) ; 
r. Utilize federal support and encourage input; 
s. Utilization of counselors as trainers; 
t. Uniformity oi: training/trainers; 
u. Statewide cross-fertilization; 
V, Analysis of organizational structure; 
w. Educate support systems/referral sources; 
X. Develop aqeacy support systems; and 
y. Methodology to evaluate client outcomes. 

2, Maintenance. 

a. Identification of poor performers/developn.jnt of 
appropriate action plans; 

b. Identification of skill deficits and appropriate 
1 n fervent ion ; 

c. Maintain commitment 
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d. Maintain policy system; 

e. Utilization of evaluation procedures of program 
and individuals; 

f. Maintain rater reliability and validity; 

q. Reinforcement of roles; i.e., supervisor as coach; 

h. Maintain flexibility; 

i. Monitor external environment; and 
j. Maintain review feedback process. 

A listing of tasks with strategies developed by the 
discussion groups is available from the project office. 
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Issue E: Effective Utilization of Management. Peioonne.1 

for Op. ^rationalizing the Management Control System 
(B''rst-line Supervisors) 

Discussion groups had the opportunity to focus on the 
role(s) of the first-line manager in relation to staff under 
his/her supervision. Group deliberations produced several 
different results .^nd reported an follows: 

1. Role changes 

Most groups ob-,erved that the ICP has effected a greater 
role changr for the first- line supervisor than any other 
position. Specifically, the forum discussion groups 
noted the followiig. 

a. Casework reviews conducted by first-line supervisor 
require more specificity with justification required 
for review response; 

b. First-line supervisor has a primary responsib.i i ity 
for identifying staff deficiencies and recommeridi iig 
training activities or developing corrective plans; 

c. A new emphasis on consultation skills requiring 

a quality professional relationship between connF.elor 
and supervisor; 

d. Responsibility for policy refinement, identif v inn , 
clarification, and/or development; 

e. Responsible for team development within his/her 
of rice ; 

f. Increased responsibility for community contact and 
resource development; 

g. Provides less supervisory direction; more "we", 
less "they;" 

h. Focus on substance as opposed to form; 

i. Relationships of roles have been clarif ied—f iral - 
line/middle manager /upper manager; 

j. Has developed skills and has tools to assure quality 
v/ork ; 

k. Shifted from "monitor" role to "supportive" role 

in relatina to counseling staff; 
1. Has responsibll ir.y for prevs/iding staff clear 

ex}.^ectat ons ; 
m. Has responsibility to assure fairness in grrO. 

negoti at ions ; 

n. Forced to be precise in accountability oKpoctntK )r)s; 
o. Has increased responsibility for decision making 

within the agency rather than only disseminating 

them from above; 
p. Has been forced to take a Iciadership role within the: 

office and the agency; 
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q. MCP has required a functional shift from revif^wer 
to coach; 

r. Prior to MCP, supervisor could focus on ono f unctiona]. 

area? functional areas have expanded significantly; 
s. Increased emphasis on ability to analyze data ; 
t. Supervisor expected to max:, mi 'je utilization of 

personnel — identify areas where human resources are 

needed and efficiently distribute and use resources; 
u. Increase involvement in accountability and utilization 

of medical and psychological consultants; and 
V. Responsibility in educating and reshaping referral 

sources. 

2. Functions 

Suggested functions of the first- line supervisor with 
processes identified were reported as follows. 

a. Function: Assure quality work within unit of 
management 

Processes : 

1. Review cases (assigned) , 

2. Review cases (non-assigned) , 

3. Provide timely feedback to counselor fcllowinq 
review, 

4. Identify policy issues needing clarification 
which affect the quality and /or interpret. tt ion 
of the quality of work performed, 

5. Review printouts, reports, etc, 

b. Function: Manage the planning and negotiation ot 
units' workload activities,. 

ProcRHses : 

1, Negotiate staff goals and ob ^-^-ictives , 

Identify and -procure noceps^ir-/ resourr^-r, , 
3. AsFiure consistency with aqcncv i-ioal;-?^ 
A. Monitor - re-neqotintc ;\s inc'.i. oated , 

5. Identify staff train Lncr n'-;ouG, 

6. Assure balance in worl'Toad distribut ion „ 

c. Function: Supervise stoff usinci cc "-ulta- r. /co-.icn.i rv.; 
inr)de.l. . 

Processes : 

1. Clarify and interpret policy and procedure, 

2. Con s true tively confront deficient per f or.inoncc , 

3. ffncourage and reinforce effective perf onvi. '.nee , 
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4. Encourage professional development, 

5. Demonstrate expected behaviors , 

6. Assist counselor with difficult cases. 

Function: Develop and manage staff development 
activities. 

Processes : 

1. Perform ongoing training needs assessment 

a. Job perfo.anance 

b. Career development, 

2. Provide training and orientation as appropriate, 

3. Arrange internal and external training. 

Function: Establish and maintain positive relations 
with the community and cooperative agencies. 

Processes : 

1. Inform interested public of policy and program 
changes , 

2. Participate in the development of joint t'::ainlno* 
activities , 

3* Participate in evaluation of coope.rativo aqro:^- 
ments/programs , 

4. Participate in various ad hoc activities, i.e-, 
Mayor Council, Job Fair, etc,, 

5. "Nurture*' politicians. 

Function: Serve as a major link In aaency ' o fnr/oal 
commu .ication structure. 

Processes : 

1. Ensure himely and accurate-: clLsBeminrj tio^ cT 
J.n-f'ormation (up, down) ^ 

2. Interpret 

a. Policy 

b. Coals 

c . Philosophy 

3. Provide feedback in all diro^ct.'.ons reqardir ^ 
sugcf est ions. 

r unction: Perform personnel admini*:^' tration acl:*.i^^^ tic: 
Processes t 

J . Recruit, interview, and selecl: staff, 

2. Negotiate individual work plans, 

3 . Conduct performance apprasials , 
4.. RoBolve personnel problems, 
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5. Conduct first- level rfivd^w in eii.ployee grievance 
process , 

fi. Negotiate and monitor flextime schedule, 
7. Assign counselor /clerical teams. 

Function: Participate as a member of the raanagememt 
team. 

Processes: 

1. Provide input for policy clarif i'::ation , 

2, Develop rater reliability, 

3. Analyze and resolve problems, i.e., staff, case 
service, etc. 

4, Develop and maintain vertical communications. 

Function: Gleefully accept and perform other duties 
as assigned. 

Processes: 

1. Remain receptive, 

2. Participate on task forces, 

3. Develop needed reports, 

4. Respond to c; oncrressional inquiries, 

5. Housekeeping chores. 
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General Group Observations 

1. Role of "coach" or "reinforcer" is necessary part of 
everything done. . . 

2. First-line supervisors are receiving better training tnan 
itiMdle level managers--have become technical experts. 

3. Competition between districts /regions/areas can be detri- 
mental to system, i.e., varying philosophies on how money 
is spent, etc. _ , ^ ^ 

4. First- line supervisor must take system objectives and maKQ 
them workable. 

5. Policy should reflect agency values. 

6. Policy must be interpreted more consistently. 

7*. Problems with policy will first be identified by first- line 
supervisor. . 

8. Development of agency or inter-agency resources is a shared 
responsibility among all practitioners; development of these 
resources must be managed by the supervisor. 

9. First- line supervisors must have the ability to identify 
training needs and arrange for these neeas to be met. 

10. MCP model should allow supervise to improve quality of 
counselor performance appraisal and allow for timely 

feedback. v j 

11. Functions of first line supervisor has not changed— -empna so. s 

has changed. 

12. Alti'ough case reviews have alv/ays been done, first" lina 
supervisors are now "buying into" the process. 

13. MCP is allowing means to actually i/uplement the Rehabili- 
tation Act of 1973, 

14. It is the responsibility of the first-lino supervisor to 
reinforce positive attitudes regarding the MCS. 

15. It is the responsibility of the first- line, supervise/, to 
reinforce agency values. _ _ 

16. Agency has responsibility to provide necGKsary training 
to meet the skill needs of supGrvii.,ion. 

17. Agency has responsibility to support supervisor m hir./hrn; 
new role. 

18. MCP not designed to make people hippy. 

19. Control function retreating— coaching beccninq' prominent.. 
20*, Manager will always have control function. 

21. MOP emphasizes leadership role of manager, 

22. Room for risk taking under MCP— as long as its docaracnted . 

23. MCP will not change creativiLy. 

24. Risk-taking more focused on counselor becauG'"! counsf-vi.or 
must make eligibility decision. 

25. Eligibility decisions forced to be concrete. 

26. MCP to counselor- "Are you aware of risk.^ involved': 
Can you justify risks?" 
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27. In past, anytJiing was acceptable; now, there is a clear- 
delineation between "yes" and "no." 

28. MCP forces usinq a decision-making process. 

29. Some supervisors have neglected management of performance 

30. MCP provides an accountability model rather than an 
authoritarian model — some counselors may see it as an 
authoritarian model. 

31. No place to hide in MCP. 

32. MCP makes job easier for supervisor wlio has maintained 
accountability. 

33. There is increased pressure on supervisor to develop 
better management skills. 

34. MCP allows for instituted clarity in counselor/super- 
visor relationship. 

35. Counselor and supervisor now have a clear understanding 
of expectations. 

36. Before MCP, any way okay; now there is a right way and 
a wrong way. 



